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A  Limited  Continuous  Speech  Recognition  system  is 
developed  based  upon  phoneme  analysis.  16  bandpass  filters 
are  used  to  obtain  the  frequency  components  of  the  input 
speech.  The  input  speech  is  broken  into  packets  of  40 
milliseconds  each.  These  packets  are  compared  with  phonemes 
in  a  template  file  by  a  differencing  of  frequency  magni¬ 
tudes.  The  resulting  phoneme  string  representation  of  the 
input  speech  is  compressed  and  compared  with  strings  in  a 
library  file  for  discrete  word  recognition.  For  continuous 
speech  recognition  the  phoneme  string  is  analyzed  a  phoneme 
at  a  time  to  construct  word  sequences.  The  word  string 
which  best  matches  the  input  phoneme  string  is  recognized  as 
the  word  sequence.  The  system  has  an  accuracy  of  about  94% 
for  discrete  word  recognition  and  about  80%  for  continuous 
speech  recognition.  The  vocabulary  used  is  the  digits  zero 
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LIMITED  CONTINUOUS  SPEECH  RECOGNITION 
BY  PHONEME  ANALYSIS 


"THE  AFTI  F  - 1 6  WILL  NOT  BE 
SUCCESSFUL  WITHOUT  SPEECH 
RECOGNITION.... CANNOT  BE  FLOWN 
DURING  FULL  COMBAT  MANEUVERS." 


..JOHN  C.  RUTH,  1981 
TECHNICAL  DIRECTOR 
F-16  ADVANCED  FIGHTER  DIV. 
GENERAL  DYNAMICS  INC. 


I.  In&r.adugfclfln 

This  report  documents  the  results  and  work  accomplished 
during  design  of  a  Limited  Continuous  Speech  Recognition 
(LCSR)  system.  The  ultimate  goal  of  this  thesis  is  to 
obtain  a  system  capable  of  recognizing  a  limited  vocabulary 
with  good  accuracy. 

Background 

LCSR  is  generally  understood  in  the  speech  research 
community  to  mean  the  problem  of  automatically  recognizing 
natural  numan  speech  consisting  of  isolated  utterances  which 
are  sequences  of  words  chosen  from  a  small  (less  than 
30  word)  vocabulary  spoken  continuously;  i.e.,  without 
pauses  or  breaks  between  words.  Speech  is  the  most 


frequently  used  real  time  communications  interface  between 


two  human  beings.  A  machine  operator  using  voice  control 
methods  is  free  to  use  his  hands  and  eyes  in  other  ways. 
This  can  be  a  great  advantage,  for  example  in  a  fighter 
aircraft.  A  pilot  can  while  undergoing  a  critical  maneuver 
have  access  to  his  fire  control  or  missile  jamming  systems 
through  voice  control.  Continuous  sp  :h  recognition, 
however  has  been  an  elusive  goal,  mainly  'e  to  variability 
that  occurs  in  speech  communication.  Th  variability  is  a 
consequence  of  speaker-to-speaker  variati_.i,  variations  in 
the  same  speaker  and  effects  of  adjacent  words  with  each 
other.  In  addition  there  is  a  background  noise  problem, 
especially  in  a  cockpit  environment. 

Ergfalfln 

The  aim  is  to  design  and  construct  an  Acoustic  Analysis 
machine  that  will  give  a  phoneme  listing  of  a  continuous 
speech  input.  The  phoneme  recognition  should  be  fairly 
accurate  in  order  to  make  the  later  word  recognition  step 
accurate.  This  machine  will  be  part  of  an  overall 
continuous  speech  recognition  system.  After  the  above 
proDlem  of  phoneme  recognition  was  solved  it  was  decided  to 
do  discrete  word  recognition  based  upon  the  output  of  the 
phoneme  recognition  system.  Once  this  was  achieved  it  was 
decided  to  do  limited  continuous  speech  recognition.  Hence 
the  overall  problem  became  to  design  a  system  for  limited 
continuous  speech  recognition. 


This  thesis  is  concerned  with  the  recognition  of 
phonemes  uttered  in  continuous  speech.  The  hardware  con¬ 
sists  of  a  preemphasis  filter,  an  automatic  gain  control 
circuit  and  a  bank  of  sixteen  bandpass  filters  covering  the 
frequency  range  of  200Hz  to  7000Hz.  The  software  consists 
of  a  routine  to  extract  a  set  of  phonemes  then  refine  them 
in  order  to  get  an  optimal  prototype  set.  Another  routine 
would  use  the  results  of  a  distance  measurement  computation 
for  pattern  matching  in  order  to  choose  possible  phoneme 
matches  for  each  time  period.  Once  the  above  was 
accomplished  the  scope  of  the  thesis  was  increased  to 
include  isolated  word  recognition  and  limited  continuous 
speech  recognition.  For  this  another  routine  is  developed 
using  shifting  and  the  same  distance  measurement  to 
construct  a  word  or  words  from  the  phoneme  sequence.  The 
vocabulary  used  consisted  of  the  digits  zero  to  nine  and 
point. 


II.  Theory  and  Techniques 


In  this  chapter  the  approach  used  for  speech 
recognition  will  be  discussed.  Initial  approaches  used  will 
be  discussed  and  reasons  given,  for  choosing  the  final 
approach  used. 

Before  going  into  the  details  it  would  be  helpful  to 
give  an  outline  of  a  phoneme  based  speech  recognition 
system.  The  first  step  is  to  take  a  speech  input  and  break 
it  up  into  a  sequence  of  sounds.  Each  element  of  the 
sequence  is  compared  against  a  set  of  unique  sounds.  These 
unique  sounds  are  the  phonemes.  After  comparison  a  sequence 
of  phonemes  is  obtained  which  represents  the  input  speech. 
This  string  is  known  as  the  pnoneme  representation  of  the 
input  speech.  This  string  is  then  processed  to  construct 
the  word  or  words  spoken. 

The  above  outline  was  used  in  developing  a  phoneme 
based  speech  recognition  system. 

The  input  speech  after  preamplification  is  passed 
through  a  preemphasis  filter.  This  preemphasis  filter  has  a 
gain  of  6db/octave  above  500Hz.  The  reason  for  this  is  that 
the  human  voice  has  a  roll  off  of  6db/octave  above  500Hz. 
(Ref.  3  )•  Next  the  input  speech  is  passed  through  an 
automatic  gain  control  circuit  having  a  60dB  dynamic  range. 
There  were  three  reasons  for  using  this  AGC  circuit.  First 
the  ASA-16  spectrum  analyzer  chip  which  follows,  requires  a 
certain  minimum  input  level  for  proper  operation. 


Second  the  energy  thresholding  used  (explained  later),  works 
on  the  basis  of  this  AGC  circuit.  Third  it  reduces 
variations  m  the  loudness  of  the  input  speech. 

The  ASA-16  spectrum  analyzer  chip  was  used  to  give 
sixteen  Dand  pass  filter  outputs  of  the  input  speech.  The 
reasons  for  using  a  bank  of  bandpass  filters  in  hardware 
(instead,  say,  of  a  fast  fourier  transform)  are  as  follows. 
First  it  eliminates  the  inherent  noise  of  a  fast  Fourier 
transform.  Secondly  the  sampling  can  be  done  at  a  much 
lower  rate.  A  typical  sampling  rate  for  a  fast  fourier 
transform  method  is  8KHz,  whereas  for  a  bandpass  filter 
approach  it  is  400Hz. 

The  outputs  of  the  sixteen  bandpass  filters  of  the  ASA- 
16  are  digitized  using  the  Eclipse  A/D/A  device.  A  sampling 
frequency  of  400Hz  was  chosen  since  this  sampled  each  filter 
output  at  a  frequency  of  25Hz.  The  output  of  each  bandpass 
filter  is  passed  through  a  low  pass  filter  having  a  cutoff 
frequency  of  25Hz.  This  sampling  rate  was  suitable  since 
the  variation  in  human  speech  does  not  go  over  25  Hz.  In 
this  way  one  '’slice"  of  the  input  speech,  that  is  outputs  of 
channels  one  through  sixteen  equals  a  time  packet  of  40 
milliseconds. 

Initially  two  slices  of  the  input  speech  were  taken  as 
a  phoneme  representation.  After  repeated  experimentation  it 
was  found  that  a  single  slice  of  sixteen  channels  was 
sufficient  to  represent  a  phoneme  sound.  Hence  a  phoneme 
sound  is  taken  to  be  40  milli  seconds  long  and  consists  of  a 


sixteen  dimensional  vector  whose  elements  are  the  outputs 
of  the  sixteen  band  pass  filters. 

After  noise  subtraction  a  20  millivolt  threshold  level 
is  used  to  get  rid  of  backgound  noise  and  D.C.  offset 
errors.  The  phonemes  or  sixteen  dimensional  vectors  are  now 
individually  energy  normalized.  This  energy  normalization 
is  necessary  for  the  phoneme  recognition,  comparison  routine 
used. 

These  energy  normalized  vectors  now  represent  the  input 
speech.  A  set  of  unique  phonemes  known  as  the  template  is 
created.  This  method  is  explained  in  detail  later.  The 
phonemes  in  this  template  set  are  now  compared  with  each  of 
the  vectors  of  the  input  speech.  Initially  a  difference 
raised  to  the  power  of  two  approach  was  used.  Finally  a 
difference  to  the  power  of  four  approach  was  used  for  the 
comparison.  This  was  done  since  it  gave  better  results 
without  overflowing  the  computer.  The  comparison  method  is 
explained  in  detail  later. 

This  completes  the  phoneme  recognition  stage.  the 
input  speech  is  now  in  the  form  of  a  sequence  of  phonemes. 

This  sequence  of  phonemes  is  now  compressed  using 
techniques  to  be  explained  later.  The  reason  for 
compression  is  to  overcome  the  variations  in  the  length  of  a 
word  when  spoken  several  times  and  the  speed  of  speaking  of 
a  speaker. 

This  compressed  phoneme  representation  of  the  input 
speech  is  fed  to  a  word  recognition  algorithm.  The  details 
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A  dynamic  microphone  placed  close  (1  inch)  to  the 
speaker's  lips  is  used  as  the  speech  input  device.  After 
preamplification  the  audio  signal  is  passed  through  a 
preemphasis  filter.  This  filter  has  a  6db/octave  gain  from 
500Hz  upwards.  An  automatic  gain  control  circuit  with  a 
dynamic  range  of  60db  is  used  after  the  filter  and  is 
followed  by  a  low  pass  filter  having  a  cutoff  frequency  of 
7000Hz.  The  output  of  the  low  pass  filter  is  fed  to  the 
analog  input  of  the  ASA-16  spectrum  analyzer  chip.  The 
sixteen  oand  pass  filter  outputs  of  the  ASA-16  are  offset 
compensated  and  fed  to  the  A/D  converter  of  the  Eclipse 
computer.  A  block  diagram  of  the  hardware  is  given  as 
Fig  3-1. 

ASA-16  Scfifitrum  Analyzer 

The  ASA-16  is  a  monolithic  audio  spectrum  analyzer 
with  16  channels  of  bandpass  filters,  half-wave  rectifiers, 
and  postfiltering.  It  is  fabricated  with  double-poly  NMOS 
technology  and  designed  using  swi tched-capacitor  filter 
techniques. 

A  detailed  functional  block  diagram  of  the  chip  is 
shown  in  Fig  3-2.  A  second-order  bandpass  filter  serves  to 
detine  the  band  of  energy  to  be  detected,  followed  by  a 
half-wave  rectifier  and  a  low-pass  filter.  This  individual 
function  channel  translates  the  analog  waveform  into  a  low- 
frequency  signal  that  represents  the  corresponding  energy 
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FIGURE  3.1  Hardware  block  diagram 


level  within  the  band.  There  Is  a  sam pi ed-and-held 
multiplexer  on  the  chip  that  sequentially  outputs  the 
sixteen  outputs.  The  multiplex  control  timing  is  also 
incorporated  on  the  chip.  Direct  access  to  outputs  of  all 
16  channels  is  also  available  through  16  bonding  pads.  The 
distribution  of  the  anlaysis  band  is  shown  in  Fig  3-3»  and 
the  corresponding  filter  center  frequencies  and  bandwidths 
are  listed  in  Table  3-1.  (Ref  2). 

The  chip  has  a  dynamic  range  of  better  than  43dB, 
linearity  of  better  than  1  percent,  and  center  frequency 
accuracy  of  better  than  1  percent.  Technical  data  of  the 
ASA-16  is  given  as  Appendix  B. 
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A  schematic  diagram  of  the  preprocessor  is  given  in 
Fig  3-4.  A  preemphasis  filter  is  used  after  the 
preamplifier  since  the  human  voice  has  an  attenuation  of 
about  6dB/octave  from  500Hz  upwards.  So  a  preemphasis 
filter  was  designed  which  has  a  gain  of  6dB/octave  from  500 
Hz  to  lOKHz.  The  frequency  response  of  the  filter  is  given 
in  Fig  3-5. 

The  effect  of  the  preemphasis  filter  can  be  seen  by 
comparing  the  three  dimensional  plots  of  the  words  zero  to 
nine  and  point,  with  and  without  the  filter.  These  three 
dimensional  plots  have  the  axlx  as  frequency,  time  and 
magnitude.  The  plots  are  given  in  Fig  3-6  to  Fig  3-27. 
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Fig  3-20  3D-plot  seven 
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Fig  3-25  3D-plot  nine  with  preemphasis 


It  is  seen  that  without  the  preemphasis  filter  the 
higher  frequency  information  is  lost,  and  especially  in  the 
case  of  the  words  two  and  three  they  look  almost  similar 
without  the  preemphasis  filter.  With  the  filter  they  can  be 
distinguished  due  to  the  amplification  of  the  higher 
frequency  components. 

The  transfer  function  of  the  preemphasis  filter  is 

l  +  3333.33 

F(s)  =  s'+ITTTTTilB 

It  is  calculated  in  Appendix  C. 

An  active  low  pass  filter  follows  the  preemphasis 
filter.  This  low  pass  filter  has  a  cutoff  frequency  of 
7000Hz.  It  has  a  passband  gain  of  17dB  and  a  peaking  factor 
of  1.  This  low  pass  filter  is  used  since  the  ASA-16 
spectrum  analyzer  chip  has  a  bandwidth  of  200Hz  to  7000Hz. 

The  transfer  function  of  the  low  pass  filter  is: 

-1.4945  x  10l° 

L(s)  =  - - -  • 

s2  +  47811.198s  +  2.188  x  109 

It  is  calculated  in  Appendix  D. 

The  frequency  response  of  the  low  pass  filter  is  given 
in  Fig  3-29. 

A  passband  gain  of  17dB  was  required  to  give  the  proper 
input  level  to  the  automatic  gain  control  circuit  that 
follows. 

The  overall  frequency  response  of  the  preemphasis 
filter  and  low  pass  filter  is  given  in  Fig  3-30. 
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Following  the  low  pass  filter  is  an  automatic  gain 
control  circuit.  This  is  used  so  that  the  ASA-16  spectrum 
analyzer  chip  gets  a  nearly  constant  average  level  input 
over  a  wide  range  of  speaker  voice  levels.  This  automatic 
gain  control  circuit  has  a  dynamic  range  of  60dB.  The  JFET 
acts  as  a  voltage-controlled  resistor  in  the  peak-detecting 
control  loop  of  the  7^1  operational  amplifier.  The  circuit 
has  an  input  range  of  20mV  to  20V.  The  output  is  about  IV- 
4V  peak  to  peak  over  the  entire  60dB  range.  The  response 
time  of  the  circuit  is  about  1  to  2  mSec.,  and  has  a  delay 
of  about  0.4  seconds.  Use  of  the  automatic  gain  control 
circuit  eliminated  the  problems  of  clipping  of  the  audio 
signal  and  also  that  of  too  low  an  input  to  the  spectrum 
analyzer  chip.  The  gain  response  of  the  AGO  circuit  is 
given  in  Fig  3-31. 

A  TTL  crystal  controlled  1MHz  clock  is  used  to  clock 
the  ASA-16  spectrum  analyzer  chip.  The  specif icaions  of  the 
ASA-16  spectrum  analyzer  chip,  requires  that  the  clock  and 
power  supply  to  the  ASA-16  chip  be  applied  simultaneously. 
The  clock  and  power  supply  are  hence  set  up  in  this  way. 
The  whole  preprocessor  board  is  powered  by  ±10V,  and  draws 
about  100mA  of  current.  The  ±10v  supply  is  obtained  by  on 
board  voltage  regulators. 

As  explained  earlier  in  the  discussion  of  the  ASA-16 
spectrum  analyzer  chip,  there  is  a  D.C.  offset  on  each  of 
the  sixteen  band  pass  filter  outputs  of  the  chip.  Also  each 
of  these  sixteen  outputs  cannot  be  terminated  with  a 


resistance  less  than  200Kohms.  For  this  reason  buffers  with 
offset  control  are  used  between  these  outputs  and  the  inputs 
to  the  analog  to  digital  converter  of  the  Eclipse  computer. 
These  inverting  buffers  are  made  of  SN72L044  quad-op  amp 
chips.  These  sixteen  outputs  give  the  frequency  information 
of  the  input  speech. 

The  Eclipse  analog  to  digital  converter  is  externally 
clocked  with  a  400Hz  TTL  signal.  This  samples  each  of  the 
16  channels  at  25Hz. 

The  whole  preprocessor  hardware  is  designed  on  a  single 
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The  software  package  works  in  five  stages.  The  first 
stage  is  the  creation  of  templates.  In  this  stage  a  maximum 
of  twenty  seconds  of  speech  is  input  to  the  system;  this 
speech  is  selected  to  include  a  large  number  of  different 
phonemes.  This  is  done  by  using  phonetically  balanced 
sentences.  After  normalization  (which  will  be  explained  in 
detail  later)  all  the  phonemes  found  are  compared  with  each 
other.  Those  phonemes  which  are  "close"  to  each  other  by 
the  distance  measurement  used  (explained  later)  are 
discarded.  This  gives  us  a  smaller  set  of  phonemes  which 
are  relatively  "far"  from  each  other,  that  is  distantly 
different.  This  set  of  phonemes  is  stored  in  a  file  to  be 
used  for  comparison  in  the  phoneme  recognition  scheme. 

The  second  stage  is  the  formation  of  the  distance 
matrix.  Here  the  phonemes  found  in  the  first  stage  are 
compared  with  each  other  and  their  distances  (explained 
later)  calculated.  These  distances  are  stored  in  lower 
triangular  form  in  a  file  called  the  distance  matrix.  This 
distance  matrix  will  be  used  in  the  data  compression  and 
word  recognition  schemes. 

The  third  stage  is  phoneme  recognition.  In  this  stage 
the  speech  input  to  be  analyzed  is  compared  with  the 
template  of  phonemes  created  in  stage  one.  This  produces  a 
string  of  phonemes  which  is  compressed  using  the  distance 
matrix.  This  string  is  the  phoneme  representation  of  the 
input  speech. 


The  fourth  stage  is  the  creation  of  a  word  library.  In 
this  stage  a  file  is  created  which  contains  the  phoneme 
representation  of  the  vocabulary.  The  phoneme  strings  for 
the  vocabulary  are  created  in  the  same  way,  as  explained  in 
stages  one  through  three.  This  library  file  of  the 
vocabulary  will  be  used  for  comparison  in  the  discrete  word 
and  continuous  word  recognition  schemes. 

The  fifth  stage  is  the  word  recognition  algorithm. 
This  is  a  recursive  algorithm  and  uses  the  threshold,  string 
lengths,  distance  matrix  and  error  value  information  to  come 
up  with  the  best  word  or  words  which  represent  the  input 
phoneme  string.  The  exact  method  will  be  explained  later. 
The  above  gives  a  general  outline  of  how  the  software 
package  works.  The  details  of  the  process  will  now  be 
given. 

Analog  to  digital  oonxaraion 

The  details  of  the  Eclipse  A/D/A  device  are  given  as 
Appendix  A,  to  Gorden  R.  Allen’s  thesis  "Expansion  of  the 
Eclipse  digital  signal  processing  system"  (Ref  1  ).  Two 
configuration  files  are  required.  One  for  program  CREATEMP 
and  the  other  for  program  SPEECH.  Program  SAMGEN  is  used  to 
create  these  files  and  they  are  given  in  Fig  4-1  and  Fig  4-2. 

The  Eclipse  A/D/A  device  is  set  up  to  sample  the 
sixteen  band-pass  filter  outputs  sequentially.  The  sampling 
is  cyclic  channel  one  to  channel  sixteen,  and  again  from 
channel  one,  and  so  on.  The  A/D  converter  is  clocked 
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"fSU'trs  you  gave  in  the  SAMGGN  dialog  are  shown  in  commpnt  lines 
>uur  inputs  are  immediately  preceded  by  a  colon  (  )  and  appear 

in  the  same  order  as  you  gave  them  to  SAMGEN. 

Target  operating  system  type  : MRD 

Number  of  DG/DAC  4300  chassis  configured:  0 

Fatal  error  handler  name  -1 

Fatal  error  handler  mailbox:  -1 

DCB  X  SAMCO  '100  -1  -1 


Number  of  Analog  Subsystem  :  1 


A/D  Con.  ftl  Device  Code  : 21  Mode: AD  Fortran  ID  *  1DS21 

External  interrupt  handler  specified  : <NONE> 

Number  of  pages  in  Data  Channel  area  : 16 

Specifying  a  starting  address  for  Data  Channel  area  :Y 

Data  Channel  starting  address  : 1BUFF 


DCB.  M 

DBS21 

D.  IDF+D.  INFfD.  DCH 

21 

DCS.  I 

DTS21 

SA1N1  16. 

I  BUFF 

DCB?C 

-1 

-1  DSS21 

DCT.  M 

DTS21 

000377  INTSA 

DSS21 

DCB.'  N 

521 

D.  FXF  ^  21 

00 

AD 

DCB  S 

DBS21 

0  AD  IS 

AD.  IN 

SAIRT 

DCB.  A 

D/A  Con  #1 

Device 

Code  : 23  Mode 

:  BD  . 

Fortran  ID  » 

External  interrupt  handler  specified  : <NONE> 

Number  of  pages  in  Data  Channel  area  : 16 

Specifying  a  starting  address  for  Data  Channel  area  :Y 

Data  Channel  starting  address  : IDUFO 


DCB  M 

DBS23 

D  IDF+D.  1NF+D.  DCH  23 

DCB  I 

DTS23 

SAINI 

16. 

IBUFO 

DCB7C 

-1 

-1  DSS23 

DCT  M 

DTS23 

000377 

INTSA 

DSS23 

DCB  N 

S23 

D  FIF 

23 

00  BD 

DCB.  S 

DBS23 

0 

BD.  IS 

BD.  IN  SAIRT 

DCB  A 

DCB.  E 

End  of  SAMCEN 

conf iguration 

file. 

Fieure  4-1  Configuration  file  for  CREATEMP 
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. Answers  you  gave  in  the  5AMGUM  dialog  are  shown  in  comment  lines. 

,  Vcut  inputs  are  immediately  preceded  by  a  colon  (: )  and  appear 
.  in  the  same  order  as  you  gave  them  to  SAMGEN 

.  Target  operating  system  type  : MHU  . 

;  Number  of  DG/DAC  4300  chassis  configured:  C 
,  Fatal  error  handler  name  -1 

>  Fatal  error  handier  mailbox.  -1 

DCB.  X  SAMCQ  100  -1  -1 


;  Number  of  Analog  Subsystem  :  1 


>  A/0  Con.  #1  Device  Code  : 21  Mode  :  AD  Fortran  ID  *  IDS21 

;  External  interrupt  handler  specified  : <NONE> 
i  Number  of  pages  in  Data  Channel  area  :  2 
;  Specifying  a  starting  address  for  Data  Channel  area  :Y 
i  Data  Channel  starting  address  : IBUFF 


DCB.  M 

DBS21 

D.  1DF+D.  INF+D. 

DCH  21 

DCB.  I 

DTS21 

SAIN  I  2. 

I  BUFF 

DCB7C 

-1 

-1 

DSS21 

DCT.  M 

DTS21 

000377 

INTSA 

DSS21 

DCB.  N 

‘  S21 

D.  FIF  21 

00  AD 

DCB  S 
DCB.  A 

DBS21 

0 

AD.  IS 

AD. IN  SAIRT 

«  D/A  Con.  #1  Device  Code  :  23  Mode  :  BD  Fortran  ID  <*  IDS23 

;  External  interrupt  handler  specified  : <NONE> 

Number  of  pages  in  Data  Channel  area  :  2 
■  Specifying  a  starting  address  for  Data  Channel  area  :Y 
i  Data  Channel  starting  address  : IBUFO 


DCB  M 

CBS23 

D.  IDF+D 

.  INF+D.  DCH  23 

DCB.  1 

DTS23 

SAIN  I 

2. 

IBUFO 

DCB7C 

-1 

-1  DSS23 

DCT.  M 

DTS23 

000377 

INTSA 

DSS23  ' 

DCB  N 

S23 

D  FIF 

23 

00  BD 

DCB.  S 
DCB  A 

DBS23 

0 

BD.  IS 

BD.  IN  SAIRT 

DCB.  E 

SAMCEN 

configuration 

file. 

Figure  4-2  Configuration  file  for  SPEECH 


externally  with  a  400Hz  TTL  signal.  This  means  that  each 
bandpass  filter  output  is  sampled  at  25Hz.  Since  the  ASA-16 
spectrum  analyzer  chip  has  a  25Hz  low  pass  filter  at  each 
band  pass  filter  output,  this  sampling  rate  of  25Hz  is 
sufficient.  The  voltage  output  of  the  sixteen  channels  of 
the  ASA-16,  each  ranges  between  OV  to  +4.5V.  Similarily  the 
outputs  of  the  sixteen  inverting  buffers  range  between  OV  to 
-4.5V.  The  Eclipse  A/D  converter  is  setup  to  accept  an 
analog  input  voltage  range  of  -5V  to  +5V. 

The  sampled  voltage  values  are  stored  in  integer  form 
in  a  buffer.  The  maximum  size  of  the  buffer  is  decided  by 
the  configuration  file  used.  A  CALL  DSTRT(IER)  command  is 
given  co  initialize  the  Eclipse  A/D/A  device.  In  case  of  an 
initialization  error  the  error  value  will  be  displayed  on 
the  terminal.  A  CALL  DOITW[  ]  command  is  used  to  do  the 
analog  to  digital  conversion.  Again  if  an  error  occurs  the 
error  number  is  displayed  on  the  screen.  A  table  of  the 
error  conditions  is  given  in  Table  4-1.  If  all  went  well 
with  the  A/D  conversion  a  message  "no  errors  reported"  is 
displayed. 

The  variable  space  to  hold  the  conversion  values  of  a 
single  converison  operation  can  be  a  maximum  of  16KW  of 
integer  array  space.  At  a  sampling  rate  of  400Hz  this  gives 
us  a  maximum  of  40  seconds  of  speech  input,  possible.  So  as 
to  reduce  processing  time  overlays  and  extended  memory 
techniques  were  not  used.  This  gave  a  20  second  speech 
input  time  for  program  CREATEMP  and  a  5sec  speech  input  time 
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Val  *e 

Meaning 

2179 

No-.LNK  routine  m  DCB.  invalid  DCB  Often 
results  from  an  invalid  device-id.  so  check  the 
device-id*.  The  first  two  characters  are  ID.  the 
third  either  S.  A.  or  0.  and  the  last  two  are 
numbers  (e  g  .  IDS2I). 

2180 

No  DCB  identifier  in  IORB,  invalid  DCB. 

Same  cause  as  2179. 

2181 

No)  used.  This  error  should  not  occur. 

2184 

No  initializing  routine  for  a  device  that  needs 
initialization.  Same  cause  as  2179. 

2185 

Output  requested  to  a  channel  for  an  illegal 
device  (e  g.,  output  to  an  A/D  converter). 

2186 

Attempt  to  set  up  a  locked  IORB  arra>.  This 
can  happen  if  a  second  DSAN/DSOR  call  uses 
the  same  IORB  array  argument  before  the 
original  DSAN/DSOR  completes. 

2187 

Unable  to  find  free  IORB  block  in  IORB 
arrav.  Can  happen  if  the  IORB  array  was 
DIMENSIONed  too  small.  A 
multiple-operation  call  needs  8  elements  4-  8 
elements  per  operation. 

2188 

No  DCB  exists  with  specified  device-id.  Same 
cause  as  2179. 

21  $9 

Attempt  to  use  unsupported  feature  (e.g.. 
mapped  call  in  unmapped  system). 

2190 

Attempt  to  return  bad  buffer.  Will  never  occur. 

2191 

An  IDAT Ax  argument  gave  an  illegal  clock 
setting  for  an  A/D  or  D/A  converter. 

Table  4.1  SAM  Fortran  error  codes 

(SAM  User's  Manual,  p.  6-9) 
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Value 


Meaning 


2192 

Illegal  conversion  count  --  more  than  255  or  less 
than  1  -  for  an  A/D  copvcrtcr  mode  in  A2; 
DC/DAC  only. 

2193 

Assembly  language  only.  Attempt  to  move  data 
channel  map  while  IORB  is  locked.  A  task 
tried  to  change  the  map  while  a  request  was 
using  the  window. 

2194 

Attempt  to  move  data  channel  map  to  an  , 
address  outside  the  window . 

2195 

Illegal  conversion  count:  less  than  1  or  more 
than  the  device  allows. 

2196 

Interrupt  occurred  from  4222  without  a  strobe 
or  latch  change. 

2197 

Assembly  language  only.  Attempt  to  use  data 
channel  map  w bile  it  is  being  initialized  or 
moved. 

2198 

Assembly  language  only  .  Data  channel  not 
initialized:  use  an  RMaP  call  before  issuing 
this  mode  A2  request. 

2199 

SAM  panic  code.  SAM  could  not  transmit 
(.IXMT)  to  the  calling  task  on  IORB  array 
completion.  SAM  aborts  the  program  unless 
you  set  up  a  fatal  error  handling  RECeive  task 
and  gave  its  name  to  SAMGEN.  as  described 
in  Chapter  5.  “Initial  Dialog". 

2200 

External  interrupt  occurred  on  a  stand-alone  j 
analog  converter,  aborting  the  request.  This 
error  returns  from  ISA  calls  only,  not  from 
DSAN/DSOR  calls. 

for  program  SPEECH.  The  actual  voltage  value  of  the  sampled 
conversion  value  can  be  calculated  using, 

VOLTAGE  =  FLOAT  (CONV.NUM)/32768.  *5  . 

Nocmallzatifip 

As  explained  before  each  cycle  i.e.  sampling  of 
channel  one  to  channel  sixteen  takes  40  milliseconds.  In 
this  way  the  input  speech  is  divided  in  slices  of  40 
milliseconds  each.  Now  each  40  millisecond  slice  is 
represented  by  a  16  dimensional  vector  got  from  the  16  band 
pass  filter  outputs.  This  16  dimensional  vector  is  a  u  it 
of  information  and  will  be  henceforth  called  a  phoneme 
representation. 

The  normalization  process  consists  of  noise 
subtraction,  thresholding,  energy  calculation  and  energy 
normalization.  The  noise  subtraction  is  done  by  assuming 
that  the  very  first  16  samples  represent  the  average  noise 
and  u.C.  offset  in  each  of  the  channels.  Hence  the  very 
first  16  dimensional  vector  is  subtracted  from  all  the 
remaining  vectors  in  the  data  buffer.  The  thresholding  is 
done  by  examining  each  component  of  every  vector  and  putting 
it  to  zero  if  it  has  an  integer  value  less  than  200.  An 
integer  value  of  200  represents  a  voltage  of: 

200  x  5 

threshold  - - -  30.5  millivolts  . 

32768 

An  energy  calculation  for  each  vector  is  done  using  the 


formula 


This  energy  information  is  stored  in  an  array  for  use  later 
on  In  the  data  compression  and  connected  word  recognition 
scnemes. 


Now  each  of  the  vectors  is  energy  normalized.  This  is 
done  by  dividing  each  component  of  a  vector  by  its  vector 
energy  and  multiplying  it  by  32000.  This  normalizes  the 
vector  to  a  value  of  32000.  Mathematically  it  is  as  follows: 


x(n,m)  = 


*(n,m)  =  32000 
16 

(x(i,m)) 

i=1 


n  s  1  to  16 
m  a  1  to  number  of 
vectors 


These  normalized  16  dimensional  vectors  now  represent 
the  input  speech  divided  into  phonemes  of  40  milliseconds 
each. 

lamalafcfi  snsaUan 

Program  CREATEMP  is  used  for  template  creation.  A 
maximum  of  40  seconds  of  speech  input  is  possible.  This 
speech  input  is  given  in  the  form  of  phonetically  balanced 
sentences.  The  aim  is  to  have  as  many  different  phonemes  as 
possible.  The  input  buffer  is  then  normalized  using  the 
method  explained  earlier.  The  normalized  phonemes  are  then 
compared  with  each  other,  by  the  distance  measurement 


technique  to  be  described  later.  Those  phonemes  which  are 
close  to  each  other  distance  wise  are  now  discarded.  The 
resultant  subset  of  phonemes  now  make  up  the  template  file. 

The  main  menu  of  program  CREATEMP  is  as  follows: 

1.  A/D  conversion 

2.  data  buffer  display 

3.  data  buffer  print 

4.  normalize 

5.  compare  phonemes 

6.  delete  unwanted  phonemes 

7.  compress  template 

8.  template  write  to  file 

9.  read  template  file 

10.  delete  specified  phonemes 

11.  exit 

Each  of  the  options  will  now  be  explained.  The  A/D 
conversion  operation  can  take  a  speech  input  of  1  second  to 
20  seconds.  The  conversion  values  are  stored  in  a  16KW 
integer  data  buffer.  The  data  buffer  display  and  data 
buffer  print  options  are  self  explanatory.  The  normalize 
option,  normalizes  the  data  buffer  as  explained  earlier. 

The  compare  phonemes,  compares  each  phoneme  (or  16 
dimensional  vector)  with  every  other  phoneme  in  the  data 
buffer.  The  comparison  is  done  using  the  vector  distance 
rule  as  follows. 


Distanced n)  =  L-  (xCn*i)  -  x^*1')4 


This  gives  a  distance  measurement  between  phoneme  (m) 
and  phoneme  (n).  Each  phoneme  wit^h  the  phoneme  closest  to 

it  and  their  distance  is  printed.  The  distance  is 

\ 

normalized  to  a  maximum  of  100  for  printing.  A  sample 
printout  is  given  in  Table  4-2.  This  gives  an  idea  of  which 
phonemes  are  too  close  to  each  other  and  must  be  deleted 
from  the  template. 

The  delete  unwanted  phonemes  option,  checks  the  energy 
value  of  each  phoneme.  From  this  energy  value  it  is  decided 
with  a  threshold  level,  whether  this  phoneme  is  noise  or  a 
speech  input.  Those  phonemes  which  have  an  energy  value 
below  the  threshold  are  deleted  as  being  noise  input. 

The  delete  specified  phoneme  option  asks  for  a  phoneme 
number  and  deletes  that  particular  phoneme.  The  aim  is  to 
delete  those  members  of  a  phoneme  string  which  are  too  close 
to  a  preceding  phoneme.  The  closeness  of  the  phonemes  is 
decided  using  option  compare  phonemes  as  explained  earlier. 

The  compress  template  option  is  used  after  the  delete 
options  to  compress  the  whole  template.  That  is  those 
phonemes  which  were  deleted  are  removed  from  the  template 
and  the  rest  compressed  together.  Note  that  this  function 
now  gives  new  numbers  to  all  the  phonemes,  since  the  number 
of  phonemes  in  the  template  are  now  reduced. 


A  .‘►V.ViV-'-N V,'\  _ 
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The  read  template  file  option,  reads  from  the  current 


directory  a  template  file  for  editing  purposes. 

The  template  write  to  file  option,  creates  a  template 
file  and  stores  the  template  in  it.  The  number  of  phonemes 
in  the  template  is  stored  in  position  (1121)  of  the  integer 
file.  This  template  file  will  be  used  in  programs  DISMAT 
and  SPEECH.  Details  of  these  programs  are  given  later. 

Matrii  Ccaaiian 

Program  DISMAT  is  used  for  distance  matrix  creation. 
The  main  menu  of  the  program  is  as  follows: 

1.  read  template  file. 

2.  form  distance  matrix. 

3.  display  distance  matrix. 

4.  print  distance  matrix. 

5.  distance  matrix  write  to  file. 

6.  read  distance  matrix  file. 

7.  display  templates. 

8.  give  distance  between  two  phonemes. 

9.  exit. 

The  read  template  file  option  is  first  used  to  read  the 
template  file  to  be  worked  on  into  a  1130  word  integer 
array.  Before  proceeding  further  it  is  necessary  to  first 
explain  what  a  distance  matrix  is.  The  distance  between 
each  phoneme  in  a  template  and  every  other  phoneme  in  the 
template  is  calculated.  These  distances  make  up  the 
distance  matrix  for  that  template.  The  aim  is  to  reduce  the 
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speech  recognition  process  time.  This  is  done  by  avoiding 
the  calculation  of  these  distances  over  and  over  again  in 
the  speech  recognition  process.  This  is  explained  in  detail 
later.  Distances  between  phonemes  is  calculated  using  the 
same  scheme  as  explained  earlier  for  phoneme  comparison. 
The  formula  used  is: 

16 

Distance^,,,  .  ^ 

i=1 

This  gives  the  vector  distance  between  phoneme  (m)  and 
phoneme  (n).  Since  the  distance  is  same  between  phoneme  (n) 
and  phoneme  (m).  Hence  only  one  distance  is  calculated  and 
stored.  The  distances  are  stored  in  a  lower  triangular 
form,  instead  of  in  a  two  dimensional  array.  The  reason  for 
doing  this  is  to  reduce  storage  space.  In  this  scheme  the 
distance  between  phoneme  (m)  and  phoneme  (n)  is  given  in 
location: 

m(m-1 ) 

Location  (m,n)  =  — - -  ♦  n 

Provided  m  is  greater  than  n.  If  m  is  less  than  n, 

a 

then  values  of  m  and  n  can  be  interchanged.  The  saving  in 
storage  area  can  be  made  obvious  with  the  help  of  an 
example.  Consider  a  template  having  70  phonemes.  Using  a 
two  dimensional  array  for  storing  the  distance  matrix  would 
require  (70  x  70)  =  4900  words  of  real  space.  On  the  other 
hand  using  a  lower  triangular  form  would  require 
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(70  x  (70-1  ))/2  +  70  =  2485  words  of  real  space.  This  is  a 
saving  of  (4900  -  2485)  =  2415  words  of  real  space. 


The  form  distance  matrix  option,  calculates  the 
distance  matrix  and  stores  it  in  a  2432  word  real  array, 
using  the  scheme  explained  above.  The  values  of  these 
distances  are  normalized  to  a  maximum  of  10000. 

The  print  distance  matrix  option,  prints  the  distance 
matrix  in  lower  triangular  array  form.  Since  the  printer 
can  only  handle  132  characters  in  a  line.  Hence  the  matrix 
is  broken  up  into  several  pages,  which  can  then  be  pasted 
together  to  display  the  whole  distance  matrix.  The  distance 
matrix  is  printed  out  in  integer  form.  It  is  also 
normalized  to  a  maximum  value  of  100  for  printing  purposes 
only.  A  sample  printed  output  is  shown  in  Table  4-2. 

The  give  distance  between  two  phonemes  option,  accepts 
two  phoneme  numbers  and  displays  their  distance.  The  rest 
of  the  options  are  quite  self  explanatory. 

As  explained  earlier  the  speech  recognition  scheme  used 
is  based  upon  phoneme  recognition  and  then  construction  of 
words  from  the  phoneme  string.  The  phoneme  recognition 
scheme  is  a  part  of  the  speech  recognition  program  called 
SPEECH.  In  program  SPEECH  a  template  file  and  its 
corresponding  distance  matrix  file  are  read  into  buffers. 
These  files  are  used  in  the  phoneme  recognition  method. 


Program  SPEECH  accepts  as  input  a  maximum  of  five 
seconds  of  speech.  This  speech  input  is  normalized  as 
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explained  earlier.  This  normalized  speech  is  the  basic 
input  to  the  phoneme  recognition  scheme.  As  explained 
earlier  a  phoneme  is  represented  by  a  16  dimensional  vector, 
which  are  the  outputs  of  the  16  bandpass  filters.  A  scheme 
similar  to  the  compare  phoneme,  explained  earlier  is  used. 

The  phoneme  recognition  routine  takes  the  first  16 
dimensional  vectors  of  the  input  speech  and  compares  it  with 
all  the  phonemes  in  the  template.  The  comparison  is  done 
based  upon  the  vector  distances  between  the  phonemes.  The 
smaller  the  vector  (i.e.  less  the  distance),  the  closer  is 
the  match  or  comparison.  The  formula  used  for  the  distance 
measure  is: 

16 

Distance^ n)  =  (S(B  1}  -  Ttn,!))4 

i=1 

where 

Distance^  nj  -  distance  between  speech  input 

*  '  phoneme  (m)  and  template  phoneme  (n). 

S(m , i )  s  1th  component  of  speech  input  phoneme  (m) . 

T(m,i)  =  component  of  template  phoneme  (n). 

The  phoneme  in  the  template  which  is  closest  to  the 
phoneme  in  the  speech  input  is  taken  as  the  phoneme 
representation  of  that  phoneme  in  the  speech  input.  In  this 
way  all  the  16  dimensional  vectors  in  the  speech  input  are 
given  phoneme  representations  from  the  template.  This  gives 
a  phoneme  string  which  represents  the  input  speech.  Those 
vectors  in  the  input  speech  which  have  an  energy  level  below 


The 


the  threshold  are  given  a  phoneme  number  of  zero, 
threshold  level  was  calculated  from  the  background  noise  of 
the  laboratory  environment.  This  was  done  by  operating  the 
system  with  no  speech  input  and  taking  an  average  energy 
value. 

The  phoneme  string  representation  of  the  input  speech 
is  then  compressed  using  a  number  of  rules  which  will  now  be 

N 

explained. 

All  adjacent  similar  phonemes  are  compressed.  That  is 
if  there  is  repetition  of  the  same  phoneme,  only  one  phoneme 
is  kept.  For  example  if  the  phoneme  string  is: 

12,  21,  21,  21,  16,  19 
it  will  be  compressed  to: 

12,  21,  16,  19. 

Leading  edge  zeros  of  the  string  are  ignored.  That  is, 
the  delay  between  start  of  speech  input  and  start  of  the 
conversion  process  is  removed.  Since  phoneme  number  zero 
represents  noise  or  no  speech  input  to  the  system. 

Two  or  more  adjacent  zero  number  phonemes  within  the 
phoneme  string  are  recognized  as  breaks  in  speech  input  and 
are  represented  by  a  single  phoneme  number  zero.  A  single 
phoneme  number  zero  within  the  phoneme  string  is  recognized 
as  a  stop  sound  within  a  word  and  is  ignored. 

Distances  between  all  adjacent  phonemes  in  the  string 
are  obtained  from  the  distance  matrix.  Those  adjacent 
phonemes  which  have  a  distance  less  than  a  given  threshold 
are  compressed.  The  compression  is  done  by  discarding  the 
higher  numbered  phoneme.  This  scheme  tends  to  give  the 
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lowest  numbered  phoneme  for  the  sub  string  of  adjacent, 
close  phonemes. 

This  compression  technique  eliminates  the  problems 
caused  due  to  variations  in  the  length  of  a  word.  That  is 
variations  due  to  the  speed  of  speaking  of  a  speaker. 

This  final  string  of  phonemes  after  compression  will  be 
used  as  input  to  the  word  recognition  scheme. 

Hand  lifcracx  arsaiian 

The  speech  input  to  be  analyzed  is  converted  into  a 
phoneme  string  as  explained  earlier.  In  order  to  be  able  to 
construct  a  word  or  words  from  this  string  of  phonemes,  it 
is  necessary  to  know  which  phonemes  actually  make  up  the 
word.  Hence  each  word  in  our  vocabulary  is  represented  by 
its  phoneme  string.  The  phoneme  string  which  comprises  a 
word  is  deduced  by  an  averaging  method. 

The  phoneme  recognition  scheme  is  run  for  a  number  of 
repetitions  of  the  same  word.  From  the  phoneme  strings 
produced  the  phoneme  string  which  is  repeated  the  maximum 
number  of  time  is  chosen. 

This  chosen  string  is  the  phoneme  representation  of 
that  particular  word.  This  process  is  repeated  for  all  the 
words  in  the  vocabulary.  The  words  in  the  vocabulary  and 
their  respective  phoneme  representations  are  given  in 
Table  4-3. 

Program  VOCAB  is  used  to  create  a  library  file 
containing  the  phoneme  representations  of  our  vocabulary. 


Table  4.3 


Word  and  their  Phoneme  Representations 


Zero 

26, 

27, 

11, 

29 

One 

29, 

36, 

46 

Two 

3, 

6, 

18 

Three 

22, 

53, 

6 

Four 

9, 

30, 

9 

Five 

13, 

38, 

39, 

11 

Six 

40, 

42 

Seven 

2, 

40, 

Ui 

oo 

>• 

48 

Eight 

*»9, 

6, 

53 

Nine 

15, 

56, 

57, 

58 

Point 

12, 

13, 

15, 

39 

Point 


This  program  is  also  used  for  editing  and  modification  of  a 
previously  created  library  file. 


Speech  recognition 

In  order  to  explain  the  speech  recognition  process  it 
is  necessary  to  first  explain  the  discrete  word  recognition 
scheme  used.  Subroutine  FINDWORD  does  the  discrete  word 
recognition  process.  The  input  to  this  subroutine  is  the 
phoneme  string  representation  of  the  input  speech.  This 
phoneme  string  is  compared  against  all  the  phoneme  strings 
in  the  library.  The  comparison  is  done  on  the  basis  of  an 
error  value.  The  error  value  is  calculated  based  upon  a 
number  of  rules,  which  will  now  be  explained. 

Each  phoneme  of  the  input  string  is  compared  with  the 
corresponding  phoneme  in  a  string  in  the  library.  Every 
word  in  the  library  is  in  the  form  of  a  phoneme  string.  The 
first  phoneme  of  the  input  string  i3  compared  against  the 
first  phoneme  of  a  word  string  in  the  library.  The  second 
against  the  second  and  so  on.  The  comparison  is  done  using 
the  distance  matrix  and  adding  that  distance  value  to  the 
error.  This  is  done  for  all  the  words  strings  in  the 
library.  No  form  of  transition  rule  for  going  to  the  next 
phoneme  is  used,  since  the  compression  stage  (as  explained 
earlier)  eliminates  multiple  adjacent  phonemes,  and  adjacent 
phonemes  which  are  too  close  to  each  other.  Hence  a  one  to 
one  comparison  is  done  between  the  input  string  and  all  the 
word  strings  in  the  library. 


Since  the  number  of  phonemes  in  a  word  differ  from  word 
to  word  a  penalty  value  is  added  to  the  error  value.  This 
penalty  value  depends  upon  the  difference  in  the  number  of 
phonemes  in  the  input  string,  and  the  number  of  phonemes  in 
a  particular  word  string  in  the  library.  By  repeated 
experimentation,  an  initial  value  of  120  was  found  for  the 
penalty,  which  gave  the  best  word  recognition  score.  The 
penalty  value  is  an  accumulative  function.  For  example  if 
the  difference  between  the  number  of  phonemes  in  the  input 
string  and  a  particular  word  string  in  the  library  is  given 
by  N,  then  the  error  is  calculated  as: 


Ei+i  =  +  120 


i  =  N-j  to  N2 
where  N2-N-j  =  N 


The  above  calculation  is  repeated  twice  again.  Once  by 
shifting  the  input  phoneme  string  one  phoneme  right  and 
again  by  shifting  the  input  phoneme  string  one  phoneme  left 
from  its  original  position. 

This  means  that  it  is  assumed  that  the  first  phoneme  in 
the  input  string  is  in  error.  This  assumption  was  made 
because  of  to  the  threshold  technique  used  in  finding  the 
start  of  a  word.  It  is  possible  to  have  noise  as  the  first 
phoneme  m  the  string  or  to  miss  the  first  phoneme  in  the 
word.  The  threshold  technique  used  was  explained  earlier  in 
the  chapter. 

In  this  an  average  value  of  error  is  calculated  for 
each  word  in  the  library.  The  word  string  in  the  library 


which  gave  the  minimum  error  value  is  chosen  as  the  best 
match  to  the  input  phoneme  string.  This  word  then  is  the 
output  of  the  discrete  word  recognition  subroutine. 


The  connected  word  recognition  scheme  makes  use  of  the 
discrete  word  recognition  scheme  as  follows.  The  input 
phoneme  string  is  checked  for  number  of  phonemes  between 
zero  phoneme  values.  Two  limits  are  put  on  the  number  of 
phonemes  in  a  word.  It  is  seen  for  the  given  vocabulary 
that  the  minimum  number  of  phonemes  in  a  word  is  two,  and 
the  maximum  number  of  phonemes  in  a  word  is  eight.  So  if 
the  number  of  phonemes  between  any  two  zeroes  is  less  than 
nine,  it  is  assumed  to  be  one  word  and  the  discrete  word 
recognition  scheme  is  used  to  find  the  word.  If  the  number 
of  phonemes  is  greater  than  or  equal  to  nine  between  any  two 
zeroes  it  is  assumed  that  this  string  consists  of  two  or 
more  words.  In  this  case  the  connected  word  recognition 
scheme  is  used.  Each  phoneme  from  the  input  string  is  added 
to  the  buffer  one  at  a  time.  After  each  addition  the 
temporary  buffer  is  assumed  to  be  a  word  string  and  the 
discrete  word  recognition  algorithm  applied  to  it.  At  the 
end  of  ten  additions,  a  deck  is  made  for  the  point  where,  in 
the  addition  of  phenomes,  the  best  match  to  a  word  in  the 
library  occured.  This  word  is  chosen  as  the  first  word  in 
the  connected  word  string.  The  above  process  is  repeated 
starting  from  the  last  phoneme  of  the  previous  word.  The 
last  phoneme  of  the  previous  word  is  used  again  since  in 
connected  speech  the  last  phoneme  of  the  previous  word  and 
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the  first  phoneme  in  the  next  word  can  be  same.  If  they  are 
not  in  a  particular  case,  the  error  is  removed  by  the 
shifting  used  in  the  discrete  word  recognition  scheme, 
explained  earlier. 

The  above  process  is  repeated  till  the  end  of  the  input 
phoneme  string  is  reached.  The  total  error  value  for  the 
whole  input  phoneme  string  is  calculated.  Next  it  is 
assumed  that  the  recognition  of  the  first  word  in  the 
connected  word  string  was  in  error.  The  next  best  match  for 
the  first  word  is  chosen  and  the  whole  above  process 
repeated.  A  total  error  value  for  this  recognition  of  the 
input  phoneme  string  is  calculated.  Next  it  is  assumed  that 
the  second  word  then  the  third  and  so  on  are  in  error  and 
all  their  total  error  values  calculated.  In  the  end  the 
process  which  gave  the  minimum  total  error  value  is  chosen 
as  the  best  recognition  of  words  for  the  input  phoneme 
string.  This  sequence  of  words  is  displayed  and  the  whole 
process  repeated  starting  with  the  next  string  of  phonemes, 
between  two  zero  numbered  phonemes.  In  this  way  discrete 
word  recognition  and  connected  word  recognition  is  done  till 


the  end  of  the  input  phoneme  string  is  reached. 

The  output  is  displayed  on  the  H— 1 9  terminal  on  a  line 


in  reverse  video  using  subroutine  WTYPE 


v.  and  Csnnlnainna 
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V.- 
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The  system  was  initially  designed  to  recognize  phonemes 
uttered  in  continuous  speech.  Once  fairly  consistent 
phoneme  recognition  was  achieved,  the  problem  of  discrete 
word  recognition  was  tackled.  Once  an  accuracy  of  about  90% 
was  achieved  with  an  eleven  word  vocabulary,  the  problem  of 
continuous  speech  recognition  was  approached.  In  the  end  an 
accuracy  of  about  80%  was  achieved  for  continuous  speech 
recognition. 

Phoneme  Recognition 

Using  program  CREATEMP  a  template  file  was  created. 
The  speec.h  input  was  given  by  a  tape  containing  the 
following  sentences. 

"It's  time  to  round  up  the  herd  of  Asain  cattle,"  "Few 
theives  are  ever  sent  to  the  jug,"  "May  we  all  hear  the 
yellow  lion  roar,"  "We  were  away  a  year  ago,"  "Zero  one 
two  three  four  five  six  seven  eight  nine  point." 

The  template  file  is  given  as  Appendix  A. 

Program  DISMAT  was  used  to  create  a  distance  matrix 
file  for  this  template  file.  The  distance  matrix  is  given 
in  Table  4-2. 

Program  SPEECH  was  used  in  the  phoneme  recognition  made 
to  give  the  phoneme  strings  recognized  for  the  words  in  our 
vocabulary.  The  words  in  the  vocabulary  contain  the  digits 


ft  7 


Table  5-1 


Phoneme  Recognition  Results 


Zero 

25,. 

27, 

18, 

11, 

34, 

Zero 

26, 

27, 

11, 

29, 

11 

One 

29, 

60, 

36, 

48 

One 

29, 

60, 

36, 

44 

Two 

3, 

6, 

18 

Two 

3, 

6, 

18, 

21 

Three 

6, 

27 

Three 

6, 

27 

Four 

9, 

30, 

9 

Four 

9, 

30, 

9 

Five 

35, 

36, 

39, 

40 

Five 

35, 

36, 

39, 

40, 

43 

Six 

40, 

42 

Six 

40, 

42 

Seven 

40, 

45, 

46, 

48 

Seven 

40, 

46, 

48 

Eight 

53, 

23, 

53, 

11 

Eight 

53, 

23, 

53, 

11 

Nine 

48, 

46, 

57, 

58 

Nine 

15, 

56, 

57, 

58 

Point 

12, 

13, 

15, 

54 

Point 

12, 

13, 

15, 

54 

zero  to  nine  and  point.  The  result  of  the  phoneme 
recognition  is  given  in  Table  5-1.  It  can  be  seen  that 
phoneme  strings  for  the  same  word  are  either  quite  similar 
or  exactly  the  same. 


DlgSE.Sfc.fi  Hard  Recognition 

Program  CLIB  was  used  to  create  a  library  file.  The 
phoneme  strings  produced  by  the  phoneme  recognition  process 
are  used  to  create  this  library  file  which  represents  our 
systems  vocabulary.  The  library  file  is  given  in  Table  5-2. 

Program  SPEECH  is  used  in  the  speech  recognition  made 
to  recognize  words  spocken  one  at  a  time  i.e.  discrete  word 
recognition.  Each  word  of  the  vocabulary  is  repeated  ten 
times.  The  discrete  word  recognition  results  are  given  in 
Table  5-3. 

An  overall  accuracy  of  about  94%  was  achieved. 


As  done  previously  program  SPEECH  is  used  in  the  speech 
recognition  mode.  A  maximum  of  5  seconds  of  speech  input  is 
possible.  Various  sequences  of  words  in  the  library  were 
tried.  A  sample  of  the  results  achieved  is  shown  in  Table 


5-4. 


The  complete  speech  recognition  system  is  very 


flexible.  For  example  to  change  the  vocabulary  of  the 
system  it  is  required  to  change  the  library  file  and  the 
output  file  WTYPE  only. 


Table  5-3 


Discrete  Word  Recognition  Results 


HfflCd 


Correctly  identj 
fini  flf  10.  tries 


Zero  .  10 
One  1 0 
Two  1 0 
Three  9 
Four  10 
Five  7 
Seven  9 
Eight  10 
Nine  8 
Point  10 


accuracy  =  93.6% 


V 


Table  5-4 


Continuous  Speech  Recognition  Results 


Sentence 

Correctly  Recognized 
out  of  5  tries 

Incorrectly  Recognized 
as : 

1 .67 

4 

1 .671 

123456789. 

3 

123456185. 

123456749. 

235.9 

5 

0.26 

5 

9870654321 

3 

187654321 

987654331 

4.27 


5 


The  system  at  this  moment  is  speaker  dependent.  An 
attempt  was  made  to  make  the  system  speaker  independent  by 
adding  phoneme  strings  for  different  people  in  the  library 
file.  This  worked  but  was  abondoned  as  not  being  a  good 
solution  to  the  problem.  It  is  possible  to  make  the  system 
speaker  independent  without  any  change  in  the  basic  system 
itself.  This  can  be  done  by  a  recursive  use  of  program 
CREATEMP  to  obtain  a  final  template  file  which  contains  all 
or  most  of  the  phoneme  sounds  in  the  English  language.  This 
can  be  done  over  a  period  of  time  since  program  CREATEMP  is 
able  to  edit  previously  created  template  files.  This 
process  would  have  taken  a  number  of  months  for  which  there 
was  no  time  during  this  thesis  effort.  It  is  recommended 
therefore  that  an  effort  be  made  in  the  future  to  use  this 
system  for  obtaining  a  good  if  not  ideal  template  file, 
this  would  greatly  increase  the  accuracy  and  vocabulary  of 
the  system. 
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Appendix  B 


ASA- 16  SPEECH  PREPROCESSOR 

The  ASA- 16  cnip  is  a  28-pin  integrated  circuit  with  4800  equivalent  transis¬ 
tors*  It  provides  audio  spectrum  analysis  over  the  range  of  intelligibility 
for  speecn  that  is  200  to  7000  Hz. 

The  analog  input  to  the  ASA-16  is  7  volts  ms  maximum*  from  a  low-output 
Impedance  source  of  600  ohms  or  less*  The  ASA-16  consists  of  16  bandpass  fil¬ 
ters  each  followed  by  a  halfwave  rectifier  and  a  second  order  low-pass  filter 
with  25-Hz  cutoff.  The  monolithic  ASA-16  utilizes  XMOS  switched-capacitor 
technology  with  100  operational  amplifiers  to  achieve  the  required  audio 
spectrum  analysis*  Additionally*  this  chip  contains  a  16-channel  analog 
multiplexer  and  decoder  and  provides  all  the  necessary  timing  signals  from  a 
single  TTL  1-MHz  clock.  Each  bandpass  filter  center  frequency  is  linearly 
related  to  Che  clock  frequency.  Clock  translation  results  in  spectral 
translation.  The  analog  multiplexer  is  addressed  via  four  TTL  lines.  The 
analog  output  of  the  chip  is  from  a  buffer  amplifier.  This  output  is  suitable 
for  input  to  a  0  to  5-volts  user-supplied  analog-to-digital  converter 
(National  part  number  ADC0804). 

The  input  and  output  signals  for  the  ASA-16  speech  preprocessor  are  shown  in 
figure  1  and  listed  in  table  1. 


CHANNEL  4 

C  1* 

as  □ 

CHANNEL  6 

CHANNEL  3 

C  2 

20 

CHANNEL  6 

CHANNEL  3 

C  3 

26  3 

CHANNEL  7 

CHANNEL  1 

C  4 

25  3 

CHANNEL  a 

ANALOG  ono 

C  5 

24  3 

MUX  OUTPUT 

analog  input 

C  6 

23  3 

AOORESS  A1 

v0o 

C  T 

22  3 

ADDRESS  A, 

VASTER  CLOCK 

ds 

2’  b 

ACORESS  A3 

OIQlTAl.  ONO 

r-4  5 

:o  3 

ADDRESS  A. 

DIGITAL  sno 

Q  to 

-9  □ 

vss 

CHANNEL  16 

CHANNEL  9 

CHANNEL  is 

q 

a 

Channel  <0 

CHANNEL  14 

C  13 

■6  □ 

CH  ANNE  «.  11 

CHANNEL  13 

C  74 

15  □ 

CHANNEL  12 

VDO  •  *10V.  :5  PERCENT 
VM  *  -10V.  iS  PERCENT 


Figure  1.  ASA-16  Speech  Preprocessor  Pin  Assignments 
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Table  1.  ASA- 16  Inpuc  and  Output  Signals 


Signal 

Pin  No. 

Signal  Description 

Channel  1  tnrougn  16 

1  through  4 

These  pins  provide  output  connection 

11  through  18 

for  each  of  the  16  spectrum  analyzer 

25  through  28 

cnannels  prior  to  multiplexing.  Iha 
high  impedance  outputs  should  be 

loaded  with  more  than  200  kilohos. 

These  low  pass  filter  outputs  permit 

using  an  external  multiplexer  and  Aj 

converter  such  as  the  National 

ADC0816. 

Analog  Input 

6 

The  speech  input  is  applied  to  this 

pin  following  microphone 

amplification.  The  input  signal 

level  should  not  exceed  7  volts  rms. 

VDD  VSS 

7,  19 

Power  is  supplied  to  the  ASA-16  us it 
these  pins.  7QQ  is  +10  volts  and 

Vss  is  -10  volts,  +5  percent. 

Master  Clock 

8 

The  master  clock  is  a  1-MHz  input 

signal  that  synchronizes  the  ASA- 16 

lbgic. 
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Tabie  1.  ASA-16  Inpuc  and  Output  Signals 


Signal 

Fin  No. 

Signal  Description 

Multiplexer  Output 

24 

The  ASA- 16  on-board  analog  multi¬ 
plexer  output  is  available  at  this 
pin.  The  output  voltage  is  4.3  volts 

dc,  +10  percent  for  a  5-volt  rms 
signal  at  the  analog  input  pin  at  the 

center  frequency  of  the  corresponding 

selected  multiplexer  channel. 

Address 

(AQ  through  A 3  ) 

20  through  23 

The  control  signals  applied  select 

the  multiplexer  channel  for  output 

from  the  ASA- 16  on-board  analog 

multiplexer*  Pin  21  is  the  MSB  and 

Pin  20  is  the  LSB. 

Digital  Ground 

9 

This  line  should  be  connected  to  a 

.low  TTL  logic  level.  With  this  input 

low,  the  analog  multiplexer  output 

corresponds  to  the  channel  specified 

by  the  active  4-bit  multiplexer 

address* 

Offset  Adjust 

5 

This  pin  provides  a  method  for 

compensation  of  the  ASA-16  offset 

characteristics. 
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15915. 494n 


f 


=  aR-|  +  aR2 

ai*!  0.1  X  15915.494  0 
=  T““  s  T”oTi 


R2  =  1 .768  x  103  a 


Hence  the  component  values  are  chosen  as: 


R1  =  1 5K  a 


R?  =  1.8K0 


C  =  0.02uF 


with  these  component  values 


_ 1  .8  x  103 _ 

(1.8  x  103)  +  (15  x  103) 


=  0.1071428 


T  =  15  x  103  x  0.02  x  10“6  =  3  x  10“**  sec. 


Hence  the  transfer  function  is: 


n  s  +  3333.33 

ps  =  s  +  JTllTTTIF" 


■*:-  .  ;v\  \ 


•  ^  .  . 


^ *■  ^.SJ1  -Tk  «.  JL  »'  *  -.V  J.  %  A * 


For  our  purpose: 


A  =  17dB 
F  =  7000Hz 


which  gives 


H0  =  7.0794 


wo  =  43982.297  rad/sec. 


Assuming  C-|  =  0.02  F  ,  the  component  values  of  the  low  pass 
filter  are  calculated  as: 

4(1  +  H0)C1 

C  = - - - =  0.6464yF  z  0.6 yF 

a  d 


Ro  = 


4  yFC'j 


=  568.41  ~  560 a 


R-,  =  — - 
1  Hr 


=  80.29  S  82 n 


Rq  =  - ~T 

3  H0  +  1 


=  70.35  *  68n 


These  values  of  components  gives  a  voltage  transfer 
function  for  the  low  pass  filter  as: 


-1.4945  x  101U 


s2  +  47811.198s  +  2.18837  x  109 
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c  ********************************************************************  **■*•'■  * 

c 

C  Title:  SPEECH.FR 

C  Author:  Copt.  Ajmal  Hussain 

C  Data:  Aug  S3 

C 

C  Function: 

C  Thi*  program  do**  continuous  speech  recognition.  It  needs  as 

C  input  a  template  filt>  th*  correspond ing  distance  matrix  File. 

C  and  library  file.  A  maximum  of  S  seconds  of  speech  input  is  taken 

C  and  typed  out  on  th*  video  consol*  (H19  terminal)  in  reverse 

C  video. 

C 

C  Environment: 

C  This  is  a  Fortran  V  program  that  has  been  desigined  to  run 

C  on  a  mapped-ROOS  Eclipse  S/250  minicomputer  equipped  with  a 

C  model  4331  single  board  converter. 

C 

C  Compile  command: 

C  FORTRAN  SPEECH 

C 

C  Load  command: 

C  RLDR/P  2/K  SPEECH  RED8UF  SR EDM  FINDWORD  UTYPE  SAMC0NFI67  «SAMLIB£ 

C 

C  Comments: 

C  The  input  files  required  by  th*  program  ar»: - 

C  Template  file - TEMP20  DA 

C  Distance  matrix  file  - MAT20  DA 

C  Library  file  — - - LIB20  DA 

C  The  hardware  should  be  connected  to  the  Eclipse  A/D/A  converter. 

C 

C  User's  guide. 

C  Th*  hardware  is  connected  to  th*  Eclipse  A/D/A  converter  as 

C  shown  in  th*  Thesis  "  Limited  Continuo*  Speech  Recognition  by 

C  Phoneme  Analysis  ".  Th*  D/A  coverter  is  clocked  externally  with 

C  a  400  Hj  TTL  signal. 

C  Program  SPEECH  is  run.  It  comes  up  with  the  main  meneu 

C  on  th*  CRT  as  follows: - 

C 

C  Program  SPEECH.  SV  executing 

C 

C  Pleas*  select  which  operation  will  be  performed 

C  0:  change  variables 

C  1:  speech  conversions 

C  2:  read  templates  from  fiJ 

C  3:  print  phonemes  found 

C  4:  read  distance  matrix  from  file 

C  9:  read  library 

C  6:  find  word 

C  7:  exit 

C  selection: ” 

C 

C  Select  operation  "  0  ".  For  TEMP20.  DA  th*  variable  values 

C  ere:- 

C  distance  limit:  0.01 

C  penalty:  8 

C  min.  word  length:  1 

C  max.  word  length:  9 

C  select  "  1  "  to  find  word* 


oonnn  oooonoooooooooooooonooo 


and  read 


From  the  main  minu  next  select  operation  "  2  " 
in  tamplata  file  M  TEMP20.  DA 


From  tha  main  manu  next  salact  oparation  "  4  "  and  read 
in  distance  matrix  Fila  “  MAT20.  DA 


From  tha  main  manu  naxt  salact  oparation  "  S  "  and  read 
in  library  fila  “  LIB2001.  DA  ”»  or  your  own  library  fila. 

From  tha  main  manu  naxt  salact  oparation  "  1  Tha 
following  massage  will  be  displayed  on  tha  screen:- 

Spaach  input  time  in  seconds  (max.  S  sacs.  ) 
or  'O'  for  main  manu  ■ 


Type  tha  desired  amount  of  time  and  press  ”  carraiga 
return  “  to  start  tha  conversion.  Speak  into  tha  microphone 
for  that  amount  of  time.  Tha  recognized  speech  will  be  displayed 
on  tha  CRT  in  reverse  video  and  tha  system  will  ask  you  for  tha 
next  amount  of  time. 


•* 

* 


(t 

* 

* 


* 

* 

* 

* 

** 


EXTERNAL  IDS21  i A/D  device 

EXTERNAL  IDS23  ; D/A  device  required  by  SAM 
COMMON  /  IBUFF  /  1DATA3<2010)  ; A/D  data  buffer 

COMMON  /  IDUFO  /  ITEMP<1280)  ; D/A  data  buffer  required  by  SAM 

INTEGER  IQRBA< 16) •  IPH0N<123>.  DEVICE.  LIB<236).  J.  K.  X.  L.  M.  N.  COUNT 
INTEGER  P. Q. R. TWORD< 10) .  W0RD< 123) . S.  T,  U.  V.  U.  REJ( 10.  10).  X.  Y.  Z.  FLAG 
REAL  HAG< 123) .  MAT<2432) .  LOIS.  TOT< 3 )  .  PEN 
DOUBLE  PRECISION  REAL  TEMP. TEMPI. TEMPS 


INITIALIZATION 


DEVICE-21 

CALL  DSTRT(IER)  .always  initialize  device 

IF  (IER.NE.  1)  CALL  ERRORCDSTRT  error”)  ;  if  'error'  display  error 

; number 


o  o  o  o  n 


MAIN  MENU 
>**•*****•' 


<s 

« 

* 


10  TYPE  "<CR> 

•Program  SPEECH.  SV  executing" 


ACCEPT  “<CR> 

•Please  select  which  operation  will  be  performed. <CR> 

*  0:  change  var iab les<CR> 

*  1:  speech  conversions<CR> 

*  2:  read  templates  from  file<CR> 

*  3:  print  phonemes  found<CR> 

*  4:  read  distance  matrix  from  file<CR> 

*  S:  read  library<CR> 

*  6:  find  word<CR> 

*  7:  ex it<CR> 

•selection: IOP 


C 


s 

|0  to 

code 

for 

selection 

IF 

<  IOP 

EQ.  0) 

GO 

TO 

11 

IF 

<IOP. 

Ed.  1 ) 

GO 

TO 

20 

IF 

<IOP 

EO.  2) 

GO 

TO 

60 

IF 

<IOP. 

EQ.  3) 

GO 

TO 

110 

IF 

<IOP. 

EQ.  4) 

GO 

TO 

140 

IF 

<  IOP 

EQ.  5) 

GO 

TO 

30 

IF 

<IOP. 

EO.  6) 

GO 

TO 

70 

IF 

<IOP 

EQ.  7) 

GO 

TO 

160 

WRITE  <10. 1) 


made 


display 


message 


if 


selection  made 


i  from  other  than  given  options 


GO  TO  10 

FORMAT  <  "<CRXCR><CRX33><160> 

•Please  make  selections  only  from  the  given  options 


*<33X16 1>") 


1 


onno 


ACCEPT  VALUES  0?  VARIABLES 


« 

* 

* 


c» 


11  TYPE  LD1S< PEN. LEN1. LEN2  .display  currant  variable  values 

ACCEPT”<CR>di stance  limit:  ".LOIS  >  distance  between  adjacent 

i phonemes,  less  than  which 
ithey  are  considered  same 

ACCEPT"<CR>penalty :  ’’.PEN  ;  penalty  to  be  added  to 

i  error  due  to  differences 
; in  number  of  phonemes  in 
; input  word  and  library 
>  word 

ACCEPT"<CR>min.  word  length:  ",LEN1  .number  of  phonemes  in  the 

.smallest  word  in  library 

ACCEPT ” <CR>ma » .  word  length:  ”>LEN2  inumber  of  phonemes  in  the 

» longest  word  in  library 

ACCEPT”<CR> 

*  1:  speech  recognition<CR> 

•  2:  just  phoneme  analysis<CR> 

•selection:  “.FWORD 

CO  Tn  .0 


i  '1  for  speech  recognition 
>'2'  just  phoneme  analysis 


86 


r»r>  r>  o  r>  r>  o  r> 


*************************************************************************************  »■,-» 

* 

A/D  CONVERSION  * 


20  IDATA1  *  61700K  »  a/d  16  channels  starting  with  channel  1  on  to 

; channel  16  cyclicly,  using  external  clock 

ACCEPT  "<CR> 

•Speech  input  time  in  seconds  (max.  5secs>  »  ", IDATA2 
IF  < IDATA2.  EO. 0}  CO  TO  10 

IF  <  (IDATA2.  LT.  6)  AND.  ( IDATA2.  NE.  0 ) )  CO  TO  23  v 
TYPE  ”<CRXCRX33X160> 

•Time  input  should  be  less  than  5  secs  and  greater  than  zero 
*<33X1 61  >“ 

CO  TO  22 

I DAT A2  *  IDATA2  *  400 
start  coversion 

CALL  DOITUdORBA,  IDS21.8,  IDATA1,  IDATA2.  IDATA3.  IER ) 

display  error  message  and  number  if  error  occured  in  A/D  coversion 
else  display  no  errors  reported 

TYPE  "  <7X7X7XCR> 

*<33X1 60> 

•Conversion  operation  completed" 

IF  (IER.  NE.  1>  TYPE  "DOIT  error  ", IER 

IF  ( IORBA< 14).  NE.  40000K)  TYPE  "I0RBA(14>  return  ”,I0RBA<14) 

IF  (IER.  EQ.  1  .AND.  IORBA< 14).  EO. 40000K)  TYPE  "No  errors  reported" 
TYPE  ”<33X1 60" 

CO  TO  <?<: 


87 


flD-fii38  021  LIMITED  CONTINUOUS  SPEECH  RECOGNITION  6V  PHONEME  2/ 

flNflLVSIS(U)  AIR  FORCE  INST  OF  TECH  WRIGHT-PflTTERSON  ftFB 
OH  SCHOOL  OF  ENGINEERING  ft  HUSSftIN  08  DEC  83 
UNCLASSIFIED  RFIT/GE/EE/83D-31  F/G  17/2  NL 


nnnnn  o  o  n  r> 


READ  TEMPLATE  FILE  * 

•I***************************************************************************** 

60  CALL  REDBUF< I TEMP.  1280.  5> 

TYPE  "  <7><7><7><CRX33X 1 60> 

•Templet**  read  into  buffer 
*<33X161>* 

00  TO  10 


NORMALIZE  INPUT  BUFFER 


» 


90  TEMP  -  O 
J  ■  1 
A  «  1 
L  •  1 

DO  93  I  -  1. (IDATA2/16) 

TEMP  -  O 

DO  92  J  •  A.  (K+13) 

IDATA3C J)  ■  IDATA3( J)  -  I DAT A3 < J-K* 1 ) 
IF  <ABS<IDATA3< J) ).  LT.  200)  IDATA3<J)-0 
TEMP  •  TEMP  ♦  FLOAT < 1 DATA3< J ) )**2 
92  CONTINUE 

TEMP  -  <  SORT <  TEMP ) / 32000 ) 

MAO  < I )  -  TEMP 


inormalit*  input  buffer  I DAT A3 
; in  packets  of  16  elements 
»  each.  Normalisation  it  done 
; to  a  value  of  32000. 

> elements  having  value 
i  less  than  200  are  mad* 

>  zero  (thresholding). 
i  the  energy  value  of  each 
i packet  < phoneme )  is  stored 
i in  array  MAO. 


DO  94  J  *  K.  < A+l 3) 

IDATA3< J)  »  FLOAT < IDATA3< J) ) /TEMP 
94  CONTINUE 


K  »  K+16 
93  CONTINUE 


onooo  o  r>  noon 


PHONEME  EXTRACTION  AND  COMPRESSION 


••*••••« #*****♦«*#*###*****##**********#**##*#*************•************#*#**# 


DO  88  I  ■  1.125  i clear  phone**  string 
IPHON(l)  •  O 
CONTINUE 

initialise  variables 

TEMP  -  0 
1*1 
M  *  O 

TEMPI  *  9.  OE  60 

DO  87  L  *  1.  IDATA2.  16  i analyze  input  buffer  a  phoneme  at  a  time 

IF  <MAC( I ).  LT.  0.  25)  00  TO  801  •  i f  energy  value  of  phoneme  is  less 

: than  0.25.  consider  it  as  noise 
i and  assign  it  phoneme  number  zero 

DO  86  K  •  1.  ( I TEMP (1121)*16)>  16  » compare  with  all  phonemes  in 

i template  file 

DO  89  N  »  -1, 1 
N  -  O 

compare  each  phoneme  of  input  buffer  with  all  phonemes  in  template 
file  element  by  element.  TEMP  accumalates  the  error  for  each  phoneme 
The  phoneme  in  the  template  with  the  smallest  error  value  is  chosen 
as  the  recognized  phoneme  and  it's  phoneme  number  added  to  the 
phoneme  string  IPHON. 

DO  85  J  «  L.  <L«-13) 

IF( <  (J+N).  EQ.  O).  OR.  <  < J+N—L ) .  ©T.  16) )  00  TO  85 
TEMP  •  TEMP  ♦  <  FLOAT  < I DAT A3 <  J+N  > )  -  FLOAT < I TEMP (K+M >>) **B 
M  ■  H  ♦  l 

85  CONTINUE 

IF  (TEMP.  QT.  TEMPI)  00  TO  82 
TEMPI  *  TEMP 
IPHON(I)  *  (K+1S)/16 
82  TEMP  -  O 
M  -  0 

C89  CONTINUE 

86  CONTINUE 

801  TEMPI  -  9.  OE  60 

I  -  I  ♦  1 

87  CONTINUE 


J 

I 


c  compraaa  phonama  atring  by  combining  adjacent  phonemea  which  are  aamo 

C  or  are  cloaer  than  variable  LDIS  from  aach  othar.  Two  or  mora  adjacent 

C  taro 'a  ara  rapraaantad  by  a  aingla  zero.  Ona  zaro  alona  i»  ignorad  at 

C  an  arror.  Tha  length  of  tha  eompraaaad  phonama  atring  i»  atorad  in 

C  variabla  'J'. 

DO  806  K  -  1.5 

DO  809  1  -  1.  <UDATA2/16>-1) 

IF  (IPHONU).  EQ  O)  CO  TO  807 
IF  < IPHON( 1  +  1 ) . EQ.  0)  CO  TO  807 
IF  (IPHONU).  £0.  IPHONU+1  )>  CO  TO  807 
N  *  IPHONU) 

P  -  IPHONU  +  1) 

IF  <N.  CT.  P>  CO  TO  810 
a  -  n 

N  «  P 

p  »  a 

810  IF(MAT( ( (N*(N-1) )/2)+P>.  CE.  LDIS)  CO  TO  807 

IF  (IPHONU).  LT.  IPHONU  +  1))  IPHONU  +  t)  ■  IPHONU) 

IF  (IPHONU).  CT.  IPHONU  +  1)  >  IPHONU)  ■  IPHONU  +  1) 

807  CONTINUE 
809  CONTINUE 
806  CONTINUE 

J  *  1 

DO  80S  1*1.  (IDATA2/16) 

IF  (UPHON(I).  EQ.  0).  AND.  (J.  EQ.  D)  CO  TO  80S 

IF  (( IPHONU  ).  EQ.  0).  AND.  UPHONU-1).  NE.  O)  )  CO  TO  805 

IF  (IPHONU).  EQ  IPHONU  +  1  )>  00  TO  805 

IPHON(J)  *  IPHONU) 

J  *  J  ♦  1 
80S  CONTINUE 

DO  808  L  •  J.  (IDATA2/16) 

IPHON(L)  -  O 

808  CONTINUE 


c****************************************************************************** 
c  * 

C  PRINT  PHONEME  STRING  * 

C  * 


110  WRITE! 12. 1 14)  sprint  compressed  phoneme  string 

L  ■  1  i 10  phonemes  on  a  lino.  Also  prints 

00  112  I  ■  hJ  t  tho  distances  between  adjacent 

WRITE (12. Ill)  IPHON(l)  s phonemes 

IF  (IPHON(I).  EQ.  0)  CO  TO  122 
IF  (L.  NE.  10)  CO  TO  116 
122  URITE(12.  114) 

L  »  0 

116  L  «  L  ♦  1 

112  CONTINUE 
WRITE! 12.  114) 

WRITE! 12, 121) 

121  FORMAT (20X) 

L  -  1 

M  -  MAT (2416) 

DO  113  I  -  1. (J-l) 

IF ( IPHON!  I ) .  OE.  IPHON! 1+1 >>  00  TO  119 

WRITE! 12. 117)  MAT ( ( ( IPHON! !+!)#( IPHON! I+l>— 1)> /2)+ IPHON! I ) ) 

CO  TO  120 

119  WRITEU2.  117)  MAT!  (<  IPHON!  I>*<  IPHON!  I  )-t > )/2>+IPH0N! 1+1 > > 

120  IF!L.  NE.  10)  CO  TO  118 
WRITE! 12. 114) 

L  -  O 

118  L  •  L  ♦  1 

113  CONTINUE 
WRITE! 12. 114) 

117  FORMAT!  CIO.  1.  Z) 

WRITE! 12. 114) 

114  FORMAT! IX) 

111  FORMAT! "♦".7X. 13. Z) 

IFIFWORD.  EQ.  1)  00  TO  70 
CO  TO  20 


140  CALL.  SREOM!  MAT,  2432) 
CO  TO  10 


CSSSSSSSSSSSSSSSSSSSSSSSSSSMStSSSSSStSSSStSSSSSSttSSSSSSSSSSMSSSSSSSSSSSSMS' 


C  ' 

C  READ  LIBRARY  FILE 

C 

C  ***********************************************  #***♦****•**•*******■****■*****♦• 


90  CALL  REDBUF1LIB, 236. 1) 
CO  TO  10 


CONTINUOUS  SPEECH  RECOGNITION 


* 


* 


»••**»••••••*•*•••*•*•••*••*+•***+** 


70  DO  180  1  *  1. 10 
DO  189  K  -  1. 10 
REJ(l.K)  •  0 
189  CONTINUE 
188  CONTINUE 

DO  187  I  -  1.  5 
TOT  < I )  -  0 
107  CONTINUE 


R  -  1 
S  •  1 

172  DO  17S  1*1. 129 
WORD ( I )  •  0 
179  CONTINUE 


79 


170 


IP  (R. OE.  <J+1>>  00  TO  20 
IF  (IPHON(R)  EQ.  0)  00  TO  170 
WORD ( S )  *  IPHON<R > 

R  ■  R  ♦  1 
S  -  S  ♦  1 
00  TO  79 

IF(S.  OT.  LEND  CO  TO  178 
R  »  R  ♦  1 
CO  TO  79 


C  start  word  recognition 

178  IF(S.  CT.  LEN2)  CO  TO  177 


C  discrete  word  recognition 


icleer  reject  leatri* 


iclear  total  error  matriz 

(initialize  string  length  variables 
•clear  temporary  word  register 


(  if  end  of  string  go  to  'get  nest 
(speech  input' 

(fill  temporary  word  register  till 
jzero  numbered  phoneme  found  or  till 
{ 10  phonemes  accumalated 

i  if  number  of  phonemes  less  than  minimum 
i word  length,  reject  zero  and  continue 
( accumalating  phonemes 


(if  string  length  greater  than  mazimum 
(word  length  go  to  continuous  speech 
( recognition 


C 


CALL  FINDUORD< WORD.  LIB.  TEMP.  MAT.  PEN.  L) 


display  recognized  word 


CALL  WTYPE<L. "OOl 12233449966778899.  .00112233449966778699.  "> 

gm  x  (initialize  string  length 

CO  TO  172  (get  nezt  string 


c 


continuous  word  recognition 


177  V  -  1 
W  .  i 
X  -  1 
V  -  1 
FLAG  -  0 


» initialize  variables 


171 

176 


DO  176  I  -  1.  10 
TUORD(I)  »  0 
CONTINUE 


i clear  temporary  word  register 


TEMP3  ■  9.  OE  60 


i initialize  error  value 


DO  173  I  •  1. 10 
TWORD < 1 )  ■  MORD(V) 

V  -  V  ♦  1 

IF  (1. LE.  2)  00  TO  173 


i create  ezpected  word  a  phoneme  at 
i a  time  till  a  maximum  of  10  phonemes 

> minimum  of  two  phonemes  in  a  word 


ling  word  to  be  correct 


CALL  FINDWORD<TUORD. LIB.  TEMP.  MAT,  PEN.  L) 

IF  <Y.  LE.  1)  00  TO  180  mo  rejection  the  first  time  arround 


IF  <  (L.  EQ.  REJ<  <Y»1 ).  <Y-1 ) ) ).  AND.  (FLAG.  EQ.  1  > )  GOTO  186 


180  ^  ‘TEMPLE.  TEMPO)  CO  TO  173  i  f  ind  word  with  minimum  error 

TEMPS  m  TEMP 
T  -  L 
U  «  I 
00  TO  173 
186  FLAG  -  0 
173  CONTINUE 


REJ(Y.  Xl-T 

TOT(Y)  »  TOT < Y )  ♦  TEMPS 
X  -  X  ♦  1 

IF  ( (W+U).  LT.  S)  00  TO  174 
IF  (Y.  LE.  4)  00  TO  179 


TOT < Y )  •  TOT(Y)/X 
8*1 

TEMP 3  •  9.  0  E60 
DO  181  I  -  l.V 

IF  <TOT < I ).  OE.  TEMP3)  00  TO  181 
TEMPS  -  TOT  < I ) 

Z  -  I 

181  CONTINUE 


. store  word  found  in  reject  matrix 
j  accumalate  total  error  of  string 

i check  if  end  of  string  reached 
f not  more  than  four  trys  for  one 
f  string 

< average  total  error  string 
> initialize  error  value 
»  find  string  with  minimum  error  value 


c 


display  word  string  reeocnized 


DO  182  I  -  1. 10 

CALL  WTYPE<REJ<Z<  1).  "00112233449966778899.  .  00112233445966778899.  .  "> 

182  CONTINUE 
189  FORMAT <"♦".  13.  Z> 

00  TO  79 

174  U  *  U  ♦  U  •  initialize  variables  to r  analyzing 

V  •  H  -  1  inait  string 

00  TO  171 

179  TOT  <  Y )  -  TOT  <  Y ) / X 

V  -  Y  ♦  1 
X  «  1 
FLA©  »  1 

V  -  1 
U  -  1 
00  TO  171 

C****************************************************************************** 

160  CALL  EXIT  i  stop  program 

END 


;  initialize  variables  t or  analyzing 
ineit  word  of  same  string 


CM***»**t*«**«**«««t*«»*«**«**«***«*#«*****t******«**»»*»»»**»*t»*»**»»**t 


uuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuu 


Title:  CREATEMP.FR 
Author:  Copt.  Ajmal  Hussain 
Date:  Aug  83 

Function: 

This  progra*  takes  a  speech  input,  normalizes  it.  deletes  unwanted 
phonemes,  compresses  the  buPPer  and  stores  it  in  a  Pile  to  be  used 
as  a  template  Pile. 

Environment: 

This  is  a  Fortran  V  program  that  has  been  desigined  to  run 
on  a  mepped-RDOS  Eclipse  S/S30  minicomputer  equipped  with  a 
model  4331  single  board  converter. 

Compile  command: 

FORTRAN  CREATEMP 

Load  command: 

RLDR/P  2/K  CREATEMP  SREDT  NEWSCR  SEE  IT  PAPER'' 

SETUP  HEADER  WRTTEMP  SAMC0NFIC3  tSAMLIBC 


Comments: 

The  hardware  should  be  connected  to  the  Eclipse  A/D/A  converter. 

Tha  program  can  be  used  to  create  a  new  template  Pile  or  to 
edit  an  existing  template  Pile. 

User's  guide: 

The  hardware  is  connected  to  the  Eclipse  A/D/A  converter 
as  shown  in  the  Thesis  "  Limited  Continuous  Speech  Recognition 
bg  Phoneme  Analysis  ".  The  A/D  converter  is  clocked  externally 
with  a  400  Hx  TTL  signal. 

Program  CREATEMP  is  run.  It  displays  the  main  menu  on  the 
CRT  as  Tallows: - 

Program  CREATEMP.  SV  executing 

Please  select  which  operation  will  be  perPormed. 

1:  A/D  conversions 
2:  data  buPPer  display 
3:  data  buPPer  print 
4:  normal ixe 
9:  compare  phonemes 
6:  delete  unwanted  phonemes 
7:  compress  templates 
8:  template  write  to  Pile 
9:  read  template  Prom  Pile 
10:  delete  speciPied  phonemes 
11:  exit 
selection: 

Select  operation  "  1  ".  The  program  will  ask  Por  the 
speech  input  time  <  a  maximum  oP  SO  seconds  oP  speech  is  possible  ). 
APter  pressing  carriage  return  input  the  required  speech  via  the 
microphone.  Any  errors  occurring  during  the  A/D  conversion  will  be 
displayed,  else  "  no  errors  reported  H  message  is  displayed  and  the 
program  returns  to  the  main  menu. 


ooooo  nnftnnnnfinnftonnnftoftftnnftn 


Select  operation  "  4  “  to  normalize  the  input  buffer  and 
return  to  the  main  menu. 

Select  operation  “  S  Thi»  compare*  all  the  phoneme*  in 
the  input  buffer  with  each  other  and  prints  all  the  phoneme  numbers 
and  their  closest  match  and  the  distance  between  them. 

Select  operation  “  6  This  deletes  all  phonemes  with 
energy  value  below  a  given  limit. 

Select  operation  “  10  "  to  delete  those  phonemes  which  are 
too  close  to  each  other. 

Select  operation  "  7  "  to  compress  the  data  buffer.  This 
must  be  done  before  storing  the  data  buffer  in  a  template  file. 

Select  operation  “  8  “  to  write  the  buffer  into  a 
template  file. 

The  rest  of  the  operations  are  self  explanatory  and  are 
used  to  analyte  that  everything  is  working  well. 

>••*••*••«**••*»*•••**••••#«*«-•*#«•••*•*•*•••****•••*•*»••*••*•*»**• 
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EXTERNAL  XDS21  i  A/D  davica 

EXTERNAL  IDS23  #  D/A  davica  rtquirad  by  SAN 

COMMON  /  I BUFF  ✓  IDATA3< 16304 >  i  A/D  data  bu fftr 

COMMON  /  IBUFO  /  IWAST  i  D/A  data  buff tr  raquirad  by  SAM 

INTEGER  XQRBA(  16)  *  IDATADOOO)  *  DEVICE,  J,  K,  X,  Le  M 
DOUBLE  PRECISION  REAL  TEMP,  TEMPI 
REAL  DXFFOOO),  IDATA6000) 


* 


INITIALIZATION 


DEVICE-21 
I DATA2- 1 6000 

CALL  DSTRT(IER)  *  always  initial iza  davica 
IF  ( IER.  NE.  1)  CALL  ERROR  <  "DSTRT  arror") 


CALL  NEWSCR 


non 


MAIN  MENU 


TYPE  "<CR> 

•Program  CREATEMP.  SV  executing" 

ACCEPT“<CR> 

•Please  select  which  oparation  will  ba  performed. <CR> 

•  1:  A/O  conversions<CR> 

•  2:  data  buffer  display<CR> 

•  3:  data  buffer  print<CR> 

•  4:  normal ize<CR> 

•  3:  compare  phonemes<CR> 

•  6.  delete  unwanted  phonemes<CR> 

•  7:  compreil  temp lat*s<CR> 

•  8:  template  write  to  file<CR> 

•  9:  read  template  from  file<CR> 

•  10:  delete  specified  phonemes<CR> 

•  11:  ei it<CR> 

•selection: I OP 

IF  (IOP.  EQ  1)  00  TO  20 
IF  <IOP. EQ. 2)  CO  TO  30 
IF  <IOP. EQ.  3)  CO  TO  30 
IF  <IOP.  EQ.  4)  CO  TO  90 
IF  (IOP.  EQ.  3)  CO  TO  100 
IF  (IOP.  EQ.  6)  CO  TO  110 
IF  (IOP.  EQ.  7)  CO  TO  120 
IF  (IOP  EQ  8)  CO  TO  60 
IF  (IOP.  EQ.  9)  00  TO  130 
IF  (IOP.  EQ.  10)  00  TO  210 
IF  (IOP.  EQ.  11)  CO  TO  80 
WRITE  (10. 1) 

CO  TO  10 

FORMAT  ("<CRXCRXCRX33X160> 

•Please  make  selections  only  from  the  given  options 
*<33X161>” ) 


1 


OOOOOO  O  ft  ft  o  o  ooo 


A/D  CONVERSION 


* 


20  IDATA1  »  61700K  j A/D  16  channels  starting  with  channel  1  on  to 

•channel  16  cyclicly.  using  asternal  clock 


22  ACCEPT"<CR> 

•Speech  input  time  in  seconds  (mas.  20secs>  ”  IDATA2 
IF  ((IDATA2.LT.  21).  AND.  ( IDATA2.  NE.  0) >  GO  TO  25 
TYPE  ”  <CR X33X 1 60> 

•Time  input  should  be  less  than  20secs  and  greater  than  zero 
*<33X1 60- 
GO  TO  22 

23  IDATA2  *  IDATA2*400 

CALL  DOITW(IORBA.  IDS21.  8.  I  DATA  1  <  IDATA2,  IDATA3.  IER ) 

TYPE  "<7><7><7XCR> 

*<33X1 60> 

•Conversion  operation  completed" 

IF  (IER.  NE.  1)  TYPE  "DOIT  error  IER 

IF  ( I ORB A (14).  NE.  40000K )  TYPE  U10RBA(14)  return  ".I0RBA(14> 

IF  (IER.  Ed.  1  AND.  IORBA( 14 ) .  EG.  40000K)  TYPE  “No  errors  reported” 
TYPE  "<33X161  >" 

GO  TO  10 


.********♦*********••*****• 
DATA  BUFFER  DISPLAY/PRINT 


30  CALL  SETUP ( IFOR.  IOP. 1ST ART.  ISTQP )  ;  get  the  parameters  specifying 

; the  section  of  data  buffer  to  be 
» worked  with. 

Display  the  user  requested  section  of  data  buffer. 

IF  (IOP.  EQ.  2)  CALL  SEEIT( IFOR.  ISTART. ISTOP.  IDATA3.  16384) 

Print  the  header  and  the  user  requested  section  of  data  buffer. 

IF  (IOP.  EG.  3)  CALL  HEADER < DEVICE.  FIRST.  LAST,  IDATA2.  IER.  IORBA.  CLOCK) 

IF  (IOP  EG.  3)  CALL  PAPER( IFOR.  ISTART.  ISTOP.  IDATA3.  IDATA2) 

00  TO  10 


r>  o  o  o  n  o  o  r»  rt  o 


WRITE  TEMPLATE  TO  FILE 


60  IDATA3<  1121  )-IDATA3<  IDATA2+-1  ) 


CALL  WRTTEMP< I DAT A3. 16364)  i lit  th •  u«»r  writ*  tpecified  »*ction* 

i of  data  buffer  to  f II* 

CO  TO  10 


NORMALIZE  DATA  BUFFER 


90  TEMP  -  0 
J  »  1 
K  »  1 
L  »  1 

DO  95  I  »  1.  < I DAT AS/ 16) 

TEMP  -  O 

DO  92  J-K,  <K*13> 

I DAT A3 < J )  »  IDATA3< J)  -  IDATA3< J-K+l > 
IF  < ABS ( IDATA3< J) ) .  LT.  200)  IDATA3<J>-0 
TEMP-TEMP* ( FLOAT < IDATA3< J) ) **2 ) 

92  CONTINUE 

TEMP- ( SORT  <  TEMP ) / 32000 ) 

IDATA6( I )  -  ABS (TEMP) 

DO  94  J-K.  <K*13> 

I DATA3  <  J ) —FLOAT  < IDATA3< J) > /TEMP 
94  CONTINUE 

H-K+16 

93  CONTINUE 


TYPE  "  <7><7><7XCRX33X  1 60> 
•Normalization  operation  completed 
*<33><161>" 

00  TO  10 


u  uuu  u 


COMPARE  PHONEMES 


100  TEMP  -  0 
TEMPI  -  9.  0E60 

DO  104  J  ■  1.  X0ATA2.  16 
DO  102  K  ■  1.  IDATA2.  16 
IP  <J.  EO.  K>  60  TO  103 
00  101  L  ■*  0.  15 

TEMP  ■  TEMP  ♦  (FLOAT <  IDATA3 <  J+L > ) -FLOAT (  IDATA3<Kt-L)  )  >**8 

101  CONTINUE 

IF  (TEMP.  6E.  TEMPI)  60  TO  103 
TEMPI  -  TEMP 

IDATA9( I NT ( ( J+13 ) /16) )  -  INT( (K+l 3 ) / 16 ) 

DIFF( INT( (J+13)/16) >  «  TEMP 

103  TEMP  «  0 

102  CONTINUE 

TEMPI  ■  9  0E60 

104  CONTINUE 

TEMP  -  O 

DO  107  I  -  1, (IDATA2/16) 

IF  (DIFF(I).  6T.  TEMP)  TEMP  *  DIFF(I) 

107  CONTINUE 

DO  108  I  -  1.  (IDATA2/16) 

DIFF(I)  «  (DIFF ( I ) /TEMP )*10O 

108  CONTINUE 

DO  103  I  -  1.  ( IDATA2/16) 

URITEU2.  106)  I,  IDATAS(I).  DIFF(I).  IDATA6(I) 

103  CONTINUE 

106  FORMAT (IX.  13.  3X.  13.  3X.611.  9.  3X.611.  3) 

CLOSE  12 

TYPE  "<7><7><7><CR><33>< 1 60> 

•Companion  completed 
*<33><16l>" 

60  TO  10 


100 


uuuuu  u  u  o  u  u 


DELETE  UNWANTED  PHONEMES 
••••••••••••••••••••••••••••••••••••••in***** 

110  K  -  0 

DO  116  L-l.  (IDATAZ/16) 

IF  (IDATA6(L>.  CT.  0.  29)  00  TO  116 
I  «  ( (L*16)-19) 

DO  111  J  -  I.  (1+19) 

IDATA3< J>  *  32000 

111  CONTINUE 
K  *  K  +  1 

116  CONTINUE 

TYPE  " <7><7><7><CR><33>< 1 60> 

•number  of  template*  :  "<  <  < IDATA2/ 16) -K ) 

TYPE  "<33><161>” 

I DAT A3 ( IDATA2+1 )  -  <  < IDATA2/ 16  > -K  > 

00  TO  10 

****************************************************************************** 
COMPRESS  DATA  BUFFER  * 


« 


120  J  «  1 

DO  121  I  *  1.  IDATA2.  16 

IF  ( (IDATA3( I ).  EQ.  32000).  AND.  (IDATA3( 1  +  1).  EO.  32000) >  CO  TO  121 
DO  123  K  •  O.  19 
IDATA3< J)»IDATA3< I+K) 

J  ■  J  ♦  1 
123  CONTINUE 

121  CONTINUE 

DO  122  I  -  ( 1DATA3< IDATA2+1 )*16>, IDATA2 
I DAT A3 ( I >  -  0 

122  CONTINUE 

TYPE  “ <7><7><7><CR><33>< 1 60> 

•Template*  compressed 

*<33><161>" 

CO  TO  10 


C  READ  TEMPLATE  FILE  * 

C  * 

C ************************************************************** **************** 

130  CALL  SREDT( IDATA3. 3400)  ;  let  th •  user  writ*  specified  sections 

TYPE  "  <7><7><7><CRX33X  1 60> 

•Templates  read  into  buffer 
*<33X161>" 

IDATA3( IDATA2+1 )  -  IDATA3(1121> 

CO  TO  10 


C ************** **************************************************************** 

c  * 

C  DELETE  SPECIFIED  PHONEMES  • 

C  * 


C************************************************************** ************  ■»*** 

210  K  •  0 

214  ACCEPT”<CR> 

•Template  number  to  delete  or  zero  to  end  :  IOP 

IF  ( (IOP  LT.  901).  AND.  (IOP.  CT.  0>>  CO  TO  212 
IF  (IOP.  EO.  O)  CO  TO  219 
TYPE  -<CRX33><160> 

•Template  number  should  be  between  1  and  900 
*<33X161>- 
00  TO  214 

212  I  -  ((I0P*16)-19> 

DO  211  J  -  I.  (1*19) 

IDATA3( J)  *  32000 

211  CONTINUE 

K  -  K  *  1 

TYPE  “<7X7X7XCRX33X160> 

•Template  deleted 
*<33X161>“ 

CO  TO  214 

219  TYPE  "Number  of  templates:  ( IDATA3C IDATA2+1 )-K) 

I DAT A3 ( I DAT A2  +  1)  »  IDATA3 < IDATA2+1 ) -K 
00  TO  10 


C**« 


80  CALL  EXIT 
END 


C** 
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Title:  D1SMAT1.FR 

Author:  Copt.  AjmI  Hussain 

Date:  Aug  83 


Function: 

This  program  takas  a  template  Pile,  calculates  the  distances 
between  each  template  and  stores  it  in  another  Pile. 


Environment: 

This  is  a ‘Fortran  V  program  that  has  been  desigined  to  run 
on  a  mapped-RDOS  Eclipse  S/2S0  minicomputer. 


Compile  command: 
FORTRAN  DISMAT1 


Load  command: 

RLDR  DISMAT1  SETUP  NEWSCR  SEE IT  SR EDM  SWRTM  SREDT~ 
SEEMAT  tFLIBC 


» 

* 


Comments: 

A  speciPied  template  Pile  is  read  Prom  the  disk, 
matrii  is  calculated  and  can  be  stored  in  another 
printed  out. 


It's  distance 
disk  Pile  or 


Ct****tttM*t«ttMM«t***M«t*****t***t»**»*»****Mt«**M*M»*«M*M»*M**>Cl 


INTECER  J.  K.  l.L.  PHONO  130) 

DOUBLE  PRECISION  REAL  TEMP. TEMPI 


REAL  MAT (2433) 
CALL  NEMSCR 


103 


-  -• ■  U  '«  «  .  •  L  -»»•»  .  .  .  •  -  .. - 


it 


MAIN  MENEU 


10  TYPE  “<CR> 

•Program  D ISM ATI  SV  executing” 

ACCEPT  "<CR> 

•Please  select  which  operation  will  be  performed^ <CR> 

•  1:  read  templates  from  file<CR> 

•  2:  form  distance  *atrlx<CR> 

•  3:  display  distance  matrix<CR> 

•  4:  print  distance  matrix<CR> 

•  9:  distance  matrix  write  to  file<CR> 

•  6:  read  distance  matrix  from  file<CR> 

•  7:  display  temp lat»s<CR> 

•  8:  give  distance  between  two  phonemes<CR> 

•  9.  exit<CR> 

•selection: 10P 

IP  < IOP.  EQ  1 )  CO  TO  20 
IF  (IOP. EO.  2)  CO  TO  30 
IF  (IOP.  EO.  3)  CO  TO  40 
IF  (IOP  EO.  41  00  TO  30 
IF  (IOP.  EQ.  31  CO  TO  60 
IF  (IOP  EQ.  6)  CO  TO  70 
IF  (IOP.  EQ.  7)  CO  TO  80 
IF  ( IOP.  EQ.  8)  CO  TO  100 
IF  (IOP.  EQ.  9)  CO  TO  90 
WRITE  ( 10. 1) 

00  TO  10 

1  FORMAT  ( "<CRXCRXCRX33><160> 

•Please  make  selections  only  from  the  given  options 
*<33X161>"  1 


C •••••••••••••••*•••••*••••••••••••••••••••••••••••••••••»••«>•••'•»•*»•••»•»••• 

c 

C  REAO  TEMPLATE  FILE  FROM  DISK 

C 

C  ••••••••••••••••••*••••••••••••••••*'•••••••••••••••••••«•••*••*«.*«.•*•*•••••«• 


CALL  SREDT(PHON.  1130) 

TYPE  " <7><7><7><CR><33>< 1 60> 
•Templates  read  into  buffer 
*<33><161>" 

CO  TO  10 


ooooo  nnnnn 


FORM  DISTANCE  MATRIX 


30  TEMP  -  0 
TEMPI  «  0 
I  -  1 

DO  31  J  m  It  <PH0N<1121)*1A).  16 
00  32  K  •  1.  (PH0N< 1 121 ) *16  > .  16 
IF  (K.  CT.  J>  GO  TO  39 
DO  33  L  ■  0.  IS 

TEMP  »  TEMP  «■  <FL0AT<PH0N<  J-H. ) -PH0N<  K«-L>  >  )**B 

33  CONTINUE 

IF<TEMP.  CT.  TEMPI)  TEMPI  -  TEMP 
MAT  < I )  »  TEMP 
I  «  I  ♦  1 
39  TEMP  »  0 
32  CONTINUE 

31  CONTINUE 
TYPE  TEMPI 

TEMPI  ■  TEMP 1/10000 

DO  34  I  •  1.  <  <  <PHQN< 1121 )*<PHQN< 1121)  —  1)) /2 >+PHON< 1121) ) 

MAT  < I )  •  MAT  < I > /TEMP 1 

34  CONTINUE 

MAT<2416)-PH0N< 1 121 ) 

TYPE  "  <7><7><7XCR><33><  1 60> 

•Distance  matrli  formed 
*<33><161>" 

00  TO  10 


DISPLAY  DISTANCE  MATRIX 


40  CALL  SEEMAT< MAT.  4910) 
GO  TO  10 


nnnn 


PRINT  DISTANCE  MATRIX 

C#**#«»#**«t#«*«»**«»M**»*M*********** 

90  ACCEPT"<CR>M*tri*  number  ii  :  ".IOP 
L  -  PH0NU121) 

WRITE! 12.  91)  IOP 

91  FORMAT! 90X. “MAT".  12) 

WRITE! 12. 98) 

WRITE! 12.  98) 

IF  IPHON11121).  LE.  40)  60  TO  92 
L  *  40 
WRITE! 12.  99) 

99  FORMAT! 3X.  Z) 

92  DO  93  I  *  l.L 
WRITE! 12. 94)  I 

93  CONTINUE 

94  FORMAT! 13. Z) 

K  ■  1 

DO  96  1  •  l.L 
WRITE! 12. 98) 

WRITEU2.  94)  I 
DO  97  J  ■  l.L 
IF! J.  CT.  I)  60  TO  97 
WRITE! 12.  94)  ! INT!MAT!K>/100) ) 

K  «  K  «■  1 

97  CONTINUE 
96  CONTINUE 

98  FORMAT! IX) 

IF!PH0NI1121).  LE.  40)  60  TO  900 

WRITE! 12. 99) 

99  FORMAT!"!*) 

WRITE! 12. 91)  IOP 
WRITE! 12.  98) 

WRITE! 12.  98) 

WRITE! 12. 99) 

DO  901  1-1.40 
WRITE! 12. 94)  I 

901  CONTINUE 
K  «  820 

DO  902  I  •  41.  PHON! 1 121 ) 

WRITE! 12. 98) 

WRITEI12.  94)  I 
DO  903  J  -  1.40 
WRITE! 12. 94)  ! INT! !MAT< !!I*!I-l))/2)  +  J)>/100>> 
903  CONTINUE 

902  CONTINUE 


uuuu  uuuu 


WRITE! 12. 59) 

WRITE! 12. 51 )  XOP 
WRITE ( 12. 58) 

WRITE! 12.  58) 

WRITE! 12. 55) 

DO  505  1  •  41.  PH0NU121) 

WRITE! 12. 54)  I 

505  CONTINUE 

DO  504  I  -  41. PHONI 1 121 ) 

WRITE! 12. 58) 

WRITE! 12.  54)  I 

DO  507  J  -  41. PHONI 1 121 ) 

IFIJ.  OT.  I)  CO  TO  507 

WRITE!  12.  54 )  I  INTI  INATI  I !  1*1 1-1 )  > /2>  «■  J)>/100>> 
507  CONTINUE 

506  CONTINUE 

500  TYPE  " <77<77<77<CR7<337< 1 60> 

•Distance  Matrix  printed 
*<337<1617“ 

QO  TO  10 


C**4MM»  ************************************************************************* 

DISTANCE  MATRIX  WRITE  TO  PILE  * 

* 


60  CALL  SWRTMIMAT. 2432)  ■  let  the  user  write  specified  sections 

TYPE  "  <7X7X77<CRX337<  160> 

•Distance  Matrix  written  to  file 
*<337<1617" 

CO  TO  10 


*****•*•*•****•***••***•**•*♦***•*******•*•*********♦*•*•**••*•***••**•*♦**■*'*■ 
READ  DISTANCE  MATRIX  PROM  PILE 

€*#*•»••♦•*••*•♦*•****•*******************••********♦♦•*•••**♦«♦*******♦*•***•' 


70  CALL  SREDM ! MAT .  2432 ) 

PHONI 1121 1-MATI2416) 

TYPE  " <77<77<77<CR7<337< 1 607 
•Distance  Matrix  read  into  buffer 
*<337<1617" 

00  TO  10 


onnon  non  onoo 


DISPLAY  TEMPLATE  FILE 


BO  CALL  SETUP ( IFOR. 2. ISTART.  I STOP )  i  get  th«  parameters  specifying 

.the  section  of  data  buffer  to  be 
» worked  with. 

Display  the  user  reguested  section  of  data  buffer. 

CALL  SEEIT<IFOR.  ISTART.  ISTOP.PHON.  1130) 

CO  TO  10 


DISPLAY  DISTANCE  BETWEEN  SPECIFIED  PHONEMES 


100  ACCEPT  "<CR> 
efirst  phoneme: *. I 

ACCEPT  " 

•second  phoneme: ".J 
L  *  MAT (2416) 

IF<  <1.  EQ.  01.  OR.  (J.  EO.  0)  >  CO  TO  10 
IF<(I.  CT.  L).  OR.  <J.  OT.  L)>  CO  TO  100 
IF( I.  CE.  J)  CO  TO  102 
K  »  I 
I  «  J 
J  «  K 

102  URITEdO.  101)  MAT <<(I*<I  —  l>)/2)  ♦  J> 

101  FORMAT! IX. "<CR>di stance  is  :  ".C12.  S) 
CO  TO  100 

€•*•••*••****••**••***•***********•******•• 


90  CALL  EXIT 
END 


uooouuuuuuuuuuoouuuuuuuu  uuuuu  uuuuu 


Title:  CLIB.  FR 

Author:  Copt.  Ajmal  Huiwin 

Dot*:  Aug  83 

Function: 

This  program  ersatas  a  new  library  or  adits  an  existing  library 
Environment: 

This  is  a  Fortran  V  program  that  has  been  desigined  to  run 
on  a  mapped-RDOS  Eclipse  S/250  minicomputer. 

Compile  command: 

FORTRAN  CLIB 


Load  command: 

RLDR  CLIB  NEWSCR  SETUP  SEE IT  REDBUF  WRTBUF  CFLIBt 
Comments: 

The  phoneme  string  representat ions  of  words  to  be  recognited  are 
stored  in  a  library  file.  Each  word  can  have  a  maximum  of  10 
phonemes. 

.*************************** **************c ************ ************* 


INTEGER  J.  K.  I.  L«  LIB (256) 


CLEAR  SCREEN 


CALL  NEWSCR 


********************* 
CLEAR  LIBRARY  ARRAY 


DO  11  I  -  1.256 
LIB  < I )  •  O 
11  CONTINUE 


109 


10  TYPE  "<CR> 

•Program  CLIB.  SV  executing" 

ACCEPT  "<CR> 

•Please  select  which  operation  will  ba  performed. <CR> 

•  1:  road  library  from  filo<CR> 

•  2:  form  library<CR> 

•  3:  display  library<CR> 

•  4:  library  writ#  to  file<CR> 

•  9:  chango  library  value<CR> 

•  6:  print  library<CR> 

•  7:  ox it<CR> 

•selection: “. IOP 


IF 

(IOP. 

EO.  1) 

00 

TO 

20 

IF 

(IOP. 

EQ.  2) 

00 

TO 

30 

IF 

(IOP. 

Ed.  3) 

GO 

TO 

40 

IF 

(IOP. 

EO.  4) 

CO 

TO 

90 

IF 

(IOP. 

EQ.  9) 

GO 

TO 

60 

IF 

(IOP. 

EO.  6) 

00 

TO 

SO 

IF 

(IOP. 

EO.  7) 

GO 

TO 

70 

WRITE  (10. 1) 

00  TO  10 

l  FORMAT  ("<CRXCRXCRX33X160> 

•Please  make  selections  only  from  the  given  options 
*<33X161>“ ) 


l 


C************»************************' 

c 

C  READ  LIBRARY  FILE 

C 

C »•••••••••••••••••••••••••••••••••••• 

20  CALL  REDBUFt LIB. 296.  1) 

00  TO  10 


N 


f 


%' v  ,V  V  SV. 


■  Vv  -.-X  ' 


110 


uuouo  uoouu  uuuoo  uuouu 


uuuu 


c 


PRINT  LIBRARY 


80  L  -  1 

DO  81  I  -  1.220 
URITEC12.  Ill)  LIB  ( I ) 
IP  (L.  ME.  10)  GO  TO  82 
URITE(12. 114) 

L  -  0 

82  L  -  L  ♦  1 

81  CONTINUE 

WRITEC12.  114) 

UR I TEC  12. 121) 

111  FORMAT ( 7X.  13. Z ) 
114  FORMAT  < 1 X ) 

121  FORMAT C20X) 

GO  TO  10 


70  CALL  EXIT 
END 


[Ui 


C 


112 


oooouuuuooooouoouooouu 


* 

Tit  1*:  FINDWORD.FR  * 

Author:  Copt.  Ajmal  Hussain  * 

Dot*:  Nov  83  * 

• 

Function:  * 

This  routine  compares  a  phoneme  string  with  word  strings  in  a  * 

library  based  upon  a  distance  matrii  to  give  the  word  in  the  * 


library  which  is  the  best  match.  * 

• 

Compile  command:  * 

FORTRAN  FINDWORD.  FR  * 

• 

Comments:  * 

The  variables  IFHQN  is  the  phoneme  string  array.  LID  is  the  library  • 
array.  TEMP3  returns  the  error  value  for  the  word  matched.  MAT  is  * 
the  distance  matrix  array.  PEN  is  the  penalty  to  be  added  for  • 

differences  in  the  number  of  phonemes  in  the  string  aid  in  a  word  * 
in  the  library.  L  returns  the  number  of  the  word  matched.  * 

» 


SUBROUTINE  FINDWORD < IPHON.  LIB.  TEMP 3, MAT, PEN. L) 

INTEGER  I.K.L. M.  IPHON< 129 ) .  LIB < 256 ) 

DOUBLE  PRECISION  REAL  TEMP.  TEMPI. TEMP 3 
REAL  MAT (2432).  PEN 

70  TEMP3  »  9.  OE  60  ; initialize  variables 

TEMP  -  0 
COUNT  -  O 

C  start  comparison 

DO  71  M  ■  1.220.10  (library  has  22  words,  each  a  maximum 

; of  10  phonemes  long 

DO  72  K  «  -1.1  (shift  phoneme  string  one  phoneme 

(left,  none  and  one  phoneme  right  to 
(account  for  error  in  first  phoneme 
i string 

DO  73  I  «  1.10  (compare  phoneme  at  a  time  for  each 

(word  in  library 

IF  <(I*K).EG.  0)  GO  TO  73  (Skip  first  phoneme  when  string  shifted 

; left  one  phoneme 

C  if  both  phonemes  zero  error  value  unchanged 

IF  < <LIB<M*I-1 )  EG.  0).  AND.  < IPHON< I*K>  EG.  0> >  CO  TO  73 

C  if  both  phonemes  not  xero  add  distance  between  phonemes  to  error  value 


IF  <(LIB<M+I-1).  NE.  0) .  AND.  < IPHON< I+K ) .  NE.  0) )  CO  TO  74 


ouuuuuouuuuuuuooouuuuouuuouooou 


Title:  Header 
Author:  Lt.  Allen 
Date:  Dec  82 

Function: 

Th i *  routine  print*  on  the  printer  a  header  specifying  an  Eclipse 
A/D/A  conversion  operation.  The  conversion  results  specified  can 
then  be  printed  beneath  the  header. 

Compile  command: 

FORTRAN  HEADER 

Comments: 

Th*  variables  that  are  passed  to  this  routine  have  the  following 
meaning, 

DEVICE  21  for  A/D  or  23  fo  D/A 

SPEC1  starting  channel  for  A/D  or  D/A 

SPEC2  ending  channel  for  A/D  or  mod*  set  for  D/A 

I DAT A2  conversion  count 

IER  DOITW  error  return 

I ORB A  th*  operation's  IORBA  array 

CLOCK  conversion  count 


SUBROUTINE  HEADER (DEVICE.  SPEC1.  SPEC2.  IDATA2,  IER.  IORBA. CLOCK) 

INTEOER  DEVICE. SPEC1. SPEC2.  IDATA2,  IER.  IORBA< 16). CLOCK 

IF  (DEVICE.  EQ.  21  .OR.  DEVICE.  EQ.  23)  60  TO  605 
CALL  ERROR! "improper  device  number") 

605  CALL  F6DAY  (IHON.  IDAY.  IYR ) 

CALL  FCTINE  ( I HOUR .  ININ.  ISEC) 

WRITE  (12. 10) 

10  FORNAT  (IX. "Eclipse  A/D/A  operation") 

WRITE  ( 12. 115) 

WRITE  (12.11)  I NON. IDAY,  IYR 

11  FORNAT  (IX.  "date:  M.  12.  “/".  12.  "/".  12) 

WRITE  (12,12)  IHOUR. ININ 

12  FORNAT  (IX. "time:  M. 12. •  :  “.  12) 

WRITE  (12.115) 

WRITE  (12, 1) 

IF  (CLOCK.  EQ.  1)  WRITE  (12.21) 

IF  (CLOCK.  EQ.  2)  WRITE  (12,24) 

IF  (CLOCK.  EQ.  3)  WRITE  (12.23) 

IF  (CLOCK.  EQ.  4)  WRITE  (12.22) 


WRITE  (12.3)  SPEC1 

IF  (DEVICE. EQ.  21 >  WRITE<12,  4>  SPEC2 
IF  (DEVICE.  EQ.  23)  WRITE(12.  8)  SPEC2 
WRITE  (12.5)  IDATA2 
WRITE  (12.6)  IER 
WRITE  (12.7) 

WRITE  (12.9)  (lORBA(I). I-l.  16) 

1  FORMAT  ( IX. "analog-to-digital  conversion") 

20  FORMAT  ( 1 X. “dig i tal-to-analog  conversion") 

2  FORMAT  (IX. "Clock:  “.12) 

3  FORMAT  (IX. "First  channel:  ".  12) 

4  FORMAT  (IX. “Last  channel:  “.12) 

5  FORMAT  ( IX. “Conversion  count:  “.13) 

8  FORMAT  (IX. "Mode:  “.12) 

6  FORMAT  (IX.  “DOIT  error:  «.I4) 

7  FORMAT  (IX. “Iorba(l-16)  (Octal  format):") 

9  FORMAT  (IX. 16(1X.06>) 

21  FORMAT  (IX. “pulse  clock”) 

22  FORMAT  (IX. "DCH  clock") 

23  FORMAT  (IX. “internal  clock") 

24  FORMAT  ( IX. “external  clock") 

WRITE  (12. 113) 

113  FORMAT  (IX) 

RETURN 

END 


oftfinonnonnoo 


Title:  NeuScr 
Author:  Lt  Alien 
Dote:  Dec  82 

Function: 

This  routine  erase*  the  screen  by  typing  24  blank  lines. 

Compile  command: 

FORTRAN  NEWSCR 

Ct***«**t»t**»*t*t****»*M*t»*t*t*****»***»*t*«t***«**t*ttt**«*H 

SUBROUTINE  NEWSCR 

DO  10  1-1.24 
TYPE 

10  CONTINUE 


C 


RETURN 

END 


Title:  Paper 
Author:  Lt  Allen 
Sate:  Dec  82 

Function: 

This  routine  print*  section*  of  an  integer  data  array  on  the 
printer  in  912-word  pages.  The  calling  program  specifies  all 
of  the  parameters  required. 

This  routine  was  designed  for  printing  data  collected  with  the 
Eclipse  A/O/A  device.  When  executing  the  real  number  print 
option,  the  integer  word  is  converted  to  the  real  number 
equivalent  that  this  device  uses  to  store  data  samples. 

Compile  command: 

FORTRAN  PAPER 

Comments: 

The  variables  that  are  passed  to  this  routine  have  the  following 
meaning. 

IFOR  display  format:  1  for  Integer.  2  for  real  number 

and  3  for  octal 


I START 
I  STOP 


ARRAY 


the  starting  page 

the  ending  page 

the  data  array  to  be  shown 

the  length  of  the  data  array 


SUBROUTINE  PAPERUFOR.  I  START.  I  STOP.  ARRAY.  LEN) 

INTEGER  IFOR. I START.  ISTOP.  LEN.  ARRAY ( LEN >.  IPRT.  IPAGE 
REAL  TOPVOLT .  REALNUM 

TOPVOLT-5.  0  j magnitude  of  Eclipse  device  bi-polar  setting 
IPRT-32 

IPACE-IST ART-1 
Il»( ISTART-1 >*912 
12-0 

IPAOE-IPAOE+1 

WRITE  <12.8)  IPAGE. IPRT 

WRITE  <12. 119) 

FORMAT  < 1 X  > 

FORMAT  < IX. “page”. 13.  "  of".  13) 

13- 0 

14- 0 

n-iin 

14-14*1 


FT 


s  J 


I 


I 


REALNUM-FLOAT < ARRAY ( 1 1 ) J/32768.  OeTOPVOLT  : convirt  to  rool  number 

IF  (IFOR.  EG.  1)  WRITE  (12.9)  ARRAY (II) 

IF  (IFOR.  EG.  2)  WRITE  (12.14)  REALNUM 
IF  (IFOR.  EQ.  3)  WRITE  (12.13)  ARRAY!  ID 
14  FORMAT  ("+M,1X.  F7.  4.  Z) 

13  FORMAT  (“+M.  IX. 16. Z) 

9  FORMAT  ("♦“. IX. 06. Z) 

IF  (14.  NE.  16)  GO  TO  629 
WRITE  (12. 119) 

13-13+1 

IF  (13.  NE.  16)  CO  TO  620 
WRITE  (12. 119) 

WRITE  (12. 119) 

12— 12+1 

IF  (12.  NE.  2)  GO  TO  619 
IF  (IPACE.  NE.  ISTOP)  GO  TO  610 


RETURN 

END 


C##+*+ **+**++•+*++****#+♦*  #*+++***+*+•***#***+**#•*+***•********♦■*#■*•—****** 
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Title:  RedBuP 

Author:  Copt.  Ajmal  Hu»»oin 
Date:  Nov  S3 


Function: 

This  routine  roads  a  section  oP  disk  Pile  into  an  integer  data 
array.  The  Pile  is  speciPied  interactively  by  the  user. 

V 

Compile  coaaand: 

FORTRAN  RED BUT 

Coaaents: 

The  variables  ARRAY  and  LEN  that  are  passed  to  this  routine  are 
the  data  array  and  it's  lengths  respectively.  INUM  speciPies  the 
number  oP  blocks  oP  data  to  be  transPered.  On  return  the  integer 
array  contains  the  user  data. 

C *********************************** ****************************************** 

SUBROUTINE  REDBUF<ARRAY,  LEN.  INUM) 

INTEGER  LEN.  ARRAY(LEN).  FILENAM<7).  INUM.  IDEC 

900  TYPE 

ACCEPT  - 

•Enter  the  Pilenaae  Par  reading:  " 

READ  <11. 2)  FILENAMU) 

3  FORMAT  <813) 

CALL  OPEN  < 1.  FILENAM.  2. IER) 

IF  < IER.  EO.  13)  00  TO  910 

IF  <IER.  NE.  1)  TYPE  “OPEN  error". IER 

CALL  RDBLK< 1.0. ARRAY.  INUM.  IER) 

IF  <IER.  ME.  1)  TYPE  "RDBLK  error". IER 
IF  < IER.  NE.  1)  00  TO  920 
CALL  RESET 
00  TO  100 

910  TYPE  "<CR> 

•This  Pile  does  not  esist. " 

00  TO  920 

920  CALL  RESET 

ACCEPT  "<CR> 

•Do  you  want  to. <CR> 

•  1:  try  another  Pile<CR> 

•  2:  return  to  the  aain  menu<CR> 

•selection:  "•  IDEC 

IF  < IDEC.  EO.  1)  00  TO  900 
IF  < IDEC.  EO.  2)  00  TO  100 
WRITE  <10. 1) 

1  FORMAT  <  "  <CRXCRXCR> 

•Please  make  selections  only  Prom  the  given  options.  "> 

00  TO  920 

100  RETURN 
END 


Title:  Seel t 
Author:  Lt  Alien 
Date:  Dec  S3 


C 

C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c< 


Function: 

Thit  routine  displays  sectione  of  an  integer  data  array  on  the 
•creen  in  12S-word  page*.  The  calling  program  specifies  all  the 
parameters  required. 


This  routine  was  designed  for  displaying  data  collected  with  the 
Eclipse  A/D/A  device.  When  eiecuting  the  real  number  display 
option.  the  integer  word  is  converted  to  the  real  number 
equivalent  that  this  device  uses  to  store  data  samples. 

Compile  command: 

FORTRAN  SEE IT 


Comments: 

The  variables  that  are  passed  to  this  routine  have  the  following 

meaning. 


IFOR 

display  format:  1 
and  3  for  octal 

I START 

the 

starting  page 

ISTOP 

the 

ending  page 

ARRAY 

the 

data  array  to 

LEN 

the 

length  of  the 

for  integer>  2  for  real  number 


be  shown 
data  array 


SUBROUTINE  SEEIT< IFOR. X START.  XSTOR.  ARRAY. LEN) 

INTEGER  IFOR. I START.  ISTOP,  LEN.  ARRAY (LEN). ITOT. IPAGE 
REAL  REALNUH.  TOPVOLT 

XTOT-12B 

TOPVOLT -5.  .magnitude  of  Eclipse  device  bi-polar  setting 


503  TYPE  “<CRXCR> 

•Press  carriage  return  to  begin  and<CR> 
•to  continue  with  the  next  page.  <CR>" 


ACCEPT 

1PA0E-ISTART-1 

1 1-< ISTART-1 ) *128 

310 

12-0 

IPAGE-IPAOE+l 

TYPE  "<CR>  page". 

313 

13-0 

320 

14-0 

of”. ITOT,  "<CR>" 


121 


,  •’  •'»  •*".  *  «  *  -  *  -  .  ."  »  *  %*  •.“  %*  *  ' 


525  Il-ll+l 
I4-I4+1 

REACNUH-FLOAT<ARRAY<U) )/ 32768  0*T0PV0LT  i convert  to  real  number 

IF  (IFOR.  EQ.  1)  WRITE  <10. 110)  ARRAY (II) 

IF  (IFOR.EO.  2)  WRITE  (10.111)  REALNUM 
IF  (IFOR.  EO.  3)  WRITE  (10.112)  ARRAY ( ID 

110  FORMAT  (IX. 06.  Z ) 

111  FORMAT  (1X.F7.  4.  Z) 

112  FORMAT  (IX. 16. Z) 

IF  (14.  NE.  B)  00  TO  525 
WRITE  (10. 115) 

115  FORMAT  (IX) 

13*13+1 

IF  ( 13.  NE.  8)  CO  TO  520 
WRITE  ( 10. 115) 

WRITE  (10.115) 

12*12+1 

IF  (12.  NE.  2)  CO  TO  515 
ACCEPT 

IF  (IPACE.  NE.  ISTOP)  CO  TO  510 

RETURN 

END 

C++++++++++++++++++++++++***********************************************' 
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• 

Title:  Setup  * 

Author:  Lt  Alien  * 

Dote:  Dec  83  • 

• 

Function:  * 

This  is  a  special  purpose  routine  used  by  program  XND1GI  and  * 

OUTDIGI.  It  allows  the  user  to  select  the  type  of  format  and  • 

section  of  data  buffer  for  printing/displaying.  • 

e 

Compile  command:  • 

FORTRAN  SETUP  • 

• 

Comments:  * 

The  variable  10P  that  is  passed  to  this  routine  has  the  value  2.  * 

for  data  buffer  display,  or  3.  for  data  buffer  print.  • 

The  other  variable  values  are  returned  to  the  calling  program  * 

as  set  by  the  user.  * 


SUBROUTINE  SETUPOFOR.  IOP.  ISTART.  ISTOP) 

330  ACCEPT  “<CR> 

•What  type  of  format?<CR> 

•  1:  two's  complement<CR> 

•  2:  real  number<CR> 

e  3:  Integer  number<CR> 

•  selection:  IFOR 

IF  < IFOR.  LT.  1 )  CO  TO  230 
IF  (IFOR.  CT.  3)  CO  TO  230 
231  IF  (IOP.EO.  2)  CO  TO  229 
IF  (IOP  Ed.  3)  CO  TO  239 

229  TYPE  "<CR> 

•There  are  128  pages  of  data,  numbered  1  through  128. <CR> 
•with  each  page  containing  128  samples.  ” 

CO  TO  290 
239  TYPE  -<CR> 

•There  are  32  pages  of  data,  numbered  1  through  32. <CR> 
•with  each  page  containing  912  samples.  ” 

290  ACCEPT  “<CR> 

•What  page  will  be  first?  ”,  ISTART 
ACCEPT  “ 

•What  page  will  be  last?  “.ISTOP 

IF  (ISTART.  LT.  1)  CO  TO  231 
I TEST* ( (-9A*I0P)f320> 

IF  (ISTOP.  CT.  ITEST)  CO  TO  231 
IF  (ISTART.  CT.  ISTOP)  CO  TO  231 

RETURN 

END 

C  ************************************************************* 
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\  ”, 


Title:  SWEOM.FR  * 

Author:  Copt.  Ajmel  Hussain  * 

Cat*:  Aug  83  • 

* 

Function:  * 

Thi«  routin*  r**d*  th*  distance  matrix  fil*  into  a  r*al  data  • 

array.  Th*  Ml*  i*  specified  interactively  by  th*  user  • 

• 

Compile  command:  * 

FORTRAN  SREOM  • 

• 

Comments:  * 

Th*  variables  ARRAV  and  LEN  that  are  passed  to  this  routin*  are  * 

th*  data  array  and  it's  length,  respectively.  On  return,  th*  array  * 
contains  th*  user  data.  * 


SUBROUT I NE  SREOM (ARRAY ,  LEN ) 

INTEGER  LEN,  F I LENAM < 7 ) «  ZDEC 
REAL  ARRAY (LEN) 

500  TYPE 

ACCEPT  M 

•Enter  th*  filename  for  reading: “ 

READ  (11.2)  F I LENAM ( 1 ) 

2  FORMAT  (S13) 

CALL  OPEN  (l.FILENAM.  2.  IER) 

IF  (IER.  Ed.  13)  GO  TO  310 

IF  (IER.  NE.  1)  TYPE  "OPEN  error". IER 

CALL  RDBLKd.  0.  ARRAY.  IS.  IER) 

IF  (IER.  NE.  1)  TYPE  "RDBLA  error", IER 
IF  (IER  NE.  1)  00  TO  320 
CALL  RESET 
GO  TO  100 

310  TYPE  "<CR> 

•This  fil*  does  not  exist. " 

00  TO  320 

320  CALL  RESET 

ACCEPT  ”<CR> 

•Do  you  want  to,  <CR> 

•  1:  try  another  fil*<CR> 

•  8:  return  to  th*  main  m*nu<CR> 

•  selection: "•  IDEC 

IF  ( IDEC.  Ed.  1 )  00  TO  900 
IF  (IDEC.  Ed.  2)  GO  TO  100 
WRITE  (10. 1) 

1  FORMAT ( "<CRXCRXCR> 

•Pleas*  make  selections  only  from  th*  given  options") 
GO  TO  320 

100  RETURN 
END 


2 


oooooooonooooonnnooo 
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* 

* 


Title:  SREDT.FR 

Author:  Copt.  Ajmal  Hussain 

Dot*:  Aug  83 

Function: 

This  routine  reads  o  section  oF  disk 
array.  The  File  and  data  section  are 
by  the  user. 


Compile  command: 

FORTRAN  SREDT 

Comments: 

The  variables  ARRAY  and 
the  data  array  and  it's 
contains  the  user  data. 


File  into 
spec iFied 


an  integer  data 
interactively 


LEN  that  are  passed  to 
length,  respectively 


this  routine  are 
On  return,  the  array 


» 


SUBROUTINE  SREDT< ARRAY.  LEN) 

INTEGER  LEN. ARRAY (LEN).  FI LENAM<7).  IFIRST.  INUM.  IDEC 

500  TYPE 

ACCEPT  " 

•Enter  the  Filename  For  reading:  “ 

READ  (11.2)  FILENAM(l) 

2  FORMAT  (513) 

CALL  OPEN  ( 1 . FILENAM.  2.  IER ) 

IF  (IER.  Ed.  13)  00  TO  510 

IF  (IER.  NE.  1)  TYPE  "OPEN  error “,IER 

IFIRST-0 

INUM-5 

CALL  RDBLM1.  IFIRST.  ARRAY,  INUM.  IER) 

IF  (IER.  NE.  1)  TYPE  "RD8LK  error*. IER 
IF  (IER.  NE.  1)  CO  TO  520 
CALL  RESET 
GO  TO  100 

510  TYPE  "<CR> 

•This  File  does  not  exist.  " 

GO  TO  520 

520  CALL  RESET 

ACCEPT  "<CR> 

•Do  you  want  to. <CR> 

•  1:  try  another  File<CR> 

•  2:  return  to  the  main  menu<CR> 

•selection: *.  IDEC 


Title:  WrtBuf 

Author:  Capt.  Ajmal  Hussain 
Data:  Oct  83 


Function. 

This  is  a  spacial  purposa  routina  usad  by  program  CREATEMP  and 
SPEECH.  It  allows  tha  usar  to  write  specified  sections  of  the 
data  buffer  to  a  disk  file. 

Compile  command: 

FORTRAN  WRTBUF 

Comments: 

The  variables  ARRAY  and  LEN  that  are  passed  to  this  routine  are 
the  data  buffer  and  it's  length,  respectively.  ISTOP  is  the  number 
of  blocks  of  integer  data  to  be  written  to  disk  file. 


* 


SUBROUTINE  WRTBUF (ARRAY.  LEN.  ISTOP > 

I NTECER  LEN, ARR AY  <  LEN  > ,  F I LENAM ( 7  > .  I STOP 
I START  -  0 
235  ACCEPT  " 

♦Enter  the  filename  for  writing:" 

READ  (11.13)  FILENAM(l) 

13  FORMAT  (S13) 

260  CALL  CFILW  (FILENAM.  2,  IER ) 

IF  (IER.  Ed.  12)  CO  TO  265 

IF  (IER.  NE.  I>  TYPE  "CFILW  error  ",  IER.  "  with  your  file 
CALL  OPEN  (1. FILENAM.  2,  IER) 

IF  (IER  NE.  1)  TYPE  "OPEN  error  ", IER, "  with  your  file” 
CALL  WRBLK ( 1 ,  ISTART.  ARRAY,  ISTOP. IER) 

IF  ( IER.  NE.  1 )  TYPE  "WRBLK  error  ", IER. "  with  your  file 
CALL  CLOSE  ( 1. IER) 

IF  (IER.  NE.  1)  TYPE  "CLOSE  error  ”, IER. "  with  your  file 
00  TO  280 

265  ACCEPT  "<CR> 

♦This  file  already  ex  ists.  <CRXCR> 

•Do  you  want  to. <CR> 

•  1:  delete  the  current  file<CR> 

•  2:  try  another  file<CR> 

♦selection: ",  1DEL 


IF  ( I  DEL.  EQ.  1)  GO  TO  270 
IF  (IDEL.  EG.  2)  GO  TO  255 
WRITE  (10. 1) 

1  FORMAT  <  "<CR><CRXCR> 

tPliiti  make  selections  only  from  the  given  options 
CO  TO  265 

270  CALL  DFILW  (FILENAM, IER > 

IF  (IER.NE.  1)  TYPE  “DFILW  err or  “.IER.”  with  your 
GO  TO  260 


* 


280  RETURN 
END 


C 
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Title:  WRTTEMP.FR 

Author:  Copt.  Ajmal  Hussain 

Dot*:  Aug  83 

Function: 

This  is  o  spociol  purpose  routine  used  by  program  CREATEMP. 

It  Allows  the  user  to  write  the  Templet*  buffer  on  to  o  disk  file. 

Compile  commend: 

FORTRAN  WRTTEMP 

Comments: 

The  variables  ARRAY  and  LEN  that  are  passed  to  this  routine  ore 
the  date  buffer  and  it's  length,  respectively. 


SUBROUTINE  WRTTEMP (ARRAY. LEN) 

INTEGER  LEN, ARRAY ( LEN ) ,  F I LENAM ( 7  > 

I START-0 
I STOP- 13 

255  ACCEPT  “ 

♦Enter  the  filename  for  writing:" 

READ  (11,15)  FILENAM(l) 

IS  FORMAT  (S13) 

260  CALL  CFILW  (FILENAM.  2.  IER ) 

IF  (IER.  EO.  12)  00  TO  265 

IF  (IER.NE. 1)  TYPE  “CFILW  error  ".IER."  with  your  file" 
CALL  OPEN  (1. FILENAM. 2, IER) 

IF  (IER.NE.  1)  TYPE  "OPEN  error  IER, "  with  your  file" 
CALL  WRBLKd.  ISTART.  ARRAY.  ISTOP.  IER) 

IF  (IER.NE .  1)  TYPE  "WR8LK  error  ", IER, “  with  your  file" 
CALL  CLOSE  ( 1. IER) 

IF  (IER.NE. 1)  TYPE  "CLOSE  error  ".IER,”  with  your  file" 
GO  TO  280 

265  ACCEPT  "<CR> 

♦This  file  already  ** i sts.  <CRXCR> 

♦Do  you  want  to. <CR> 

*  1:  delete  the  current  file<CR> 

♦  2:  try  another  file<CR> 

♦selection: ". IDEL 


0<JO<JOOOOOU<JOUUOO<JO 


Title:  WRTMAT  FR 

Author:  Copt.  Ajmol  Huixin 

Dott:  Aug  83 

Function: 

This  is  o  sptciol  purpose  routine  used  by  program  D ISM AT 1 
It  allows  the  user  to  write  the  distance  matrix  to  a  disk  file 

Compile  command: 

FORTRAN  WRTMAT 

Comments: 

The  variables  ARRAY  and  LEN  that  are  passed  to  this  routine  are 
the  data  buffer  and  it's  length,  respectively. 


SUBROUTINE  WRTMAT( ARRAY,  LEN) 

INTEGER  LEN,  FILENAME) 

REAL  ARRAY (LEN) 

ISTART»0 

IST0P-7B 

333  ACCEPT  “ 

•Enter  the  filename  for  writing: “ 

READ  (11.13)  FILENAM(l) 

13  FORMAT  (S13) 

360  CALL  CFILU  (FILENAM. 3.  IER > 

IF  (IER  EG.  13)  CO  TO  363 

IF  (IER.NE  1)  TYPE  "CFILW  error  IER. “  with  your  file" 
CALL  OPEN  (1. FILENAM. 2. IER) 

IF  (IER.NE.  1)  TYPE  "OPEN  error  ".IER."  with  your  file" 
CALL  WRBLKd,  ISTART,  ARRAY.  ISTOP.  IER) 

IF  (IER.NE  1)  TYPE  "WRBLK  error  ".IER."  with  your  file” 
CALL  CLOSE  ( 1.  IER) 

IF  (IER.NE.  1)  TYPE  "CLOSE  error  ".IER.”  with  your  file" 
00  TO  380 

363  ACCEPT  "<CR> 

•This  file  already  ex  i  sts.  <CRXCR> 

•Do  you  want  to. <CR> 

•  I:  delete  the  current  file<CR> 

•  3:  try  another  file<CR> 

•selection: ". IDEL 


IF  (IDEL.  EQ  1)  OQ  TO  270 
IF  < IDEL.  EQ.  2)  CO  TO  235 

WRITE  (10. 1) 

1  FORMAT  ("<CRXCRXCR> 

•Pleese  mIii  ••lections  only  from  th •  given  options.  “) 
CO  TO  263 

270  CALL  OFILW  (FILENAM. IER) 

IF  (IER  NE.  1)  TYPE  "DFILW  error  IER.  “  with  gour  File* 
CO  TO  260 

280  RETURN 
END 
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Title:  WTYPE.  FR 

Author:  Copt.  Ajmal  Hu**ain 

Oat*:  Oct  63 

Thi»  routine  display*  th*  word  specified  on  th*  H19  terminal  in 
nvtrtt  vidoo  on  a  *ingl*  line. 

Compile  command. 

FORTRAN  WTYPE.  FR 

Comment*  .  .  ,  . 

Th*  variable*  L  i*  th*  word  from  th*  array  to  b*  displayed. 

U  i*  th*  array  which  contain*  th*  word*  in  the  library 


SUBROUTINE  WTYPE (L.  W) 

INTEGER  L.  W( 90 > 

IF(L  EQ.  O)  CO  TO  10 

WRITE(13. 19)  L 

WRITEU3.  1*>  W< < <L-1 >/10)+l) 

WRITEUO.  11)  W<<<L-D/lO)rl) 

FORMAT  <  "♦"» SI. Z) 

FORMAT <  " <33>< 1 60> " .  SI.  "<33:><161>".  Z  ) 
FORMAT  <  2X.  14) 

CONTINUE 


;*kip  lero  numbered  wu'ii 
; print  word 

;  display  word 


RETURN 

END 


i 


S 


133 


*  *  *'•  m  ' 


*.  *  S.*  *  *  •  *  *  »  ‘  <  's".!'*'.’** 


V 


j  imv  r»r  F  ; 


nnonnnnnnnnnnnnnnn 


C 


Title:  REDMAT 

Author:  Copt.  Ajmal  Hut xin 
Dot*:  Aug  83 

Function: 

This  routino  roods  o  soction  of  disk  fils  into  on  intogor  doto 
arroy.  Tho  fils  ond  doto  soction  oro  specified  interactively 
by  the  user. 

Compile  commend: 

FORTRAN  REDBUF 

Comments. 

The  variables  ARRAY  ond  LEN  that  or*  passed  to  this  routine  or* 
the  doto  array  ond  it's  length,  respectively.  On  return,  the  array 
contains  the  user  doto. 

• 


SUBROUTINE  REDMAT (ARRAY,  LEN) 

INTEGER  LEN. FILENAM(7).  XF1RST,  INUM.  IDEC 

REAL  ARRAY (LEN) 

500  TYPE 

ACCEPT  ” 

♦Enter  the  filename  for  reeding  " 

READ  (11.2)  FILENAM(l) 

2  FORMAT  (S13) 

CALL  OPEN  < 1.  FILENAM.  2.  IER ) 

IF  (IER  EQ.  13)  60  TO  310 

IF  (IER. NE.  1)  TYPE  “OPEN  error".  IER 

IFIRST-0 
INUM- 78 

CALL  RDBLM1.  IFIRST,  ARRAY.  INUM.  IER) 

IF  (IER  NE.  1)  TYPE  "RDBLK  error”. IER 
IF  (IER  NE.  1)  GO  TO  320 
CALL  RESET 
GO  TO  100 

310  TYPE  "<CR> 

♦This  file  does  not  exist. " 

GO  TO  320 


920  CALL  RESET 

ACCEPT  “<CR> 

•Do  you  wont  to. <CR> 

•  1:  try  another  Pile<CR> 

•  2:  return  to  tho  main  «enu<CR> 

•  ••lection: I DEC 

IF  (IDEC.  Ed.  1)  00  TO  900 
IF  (IDEC.  EO.  2)  00  TO  100 
WRITE  (10. 1) 

l  FORMAT  <  -  <CRXCRXCR> 

•Please  Make  selections  only  from  the  given 
CO  TO  920 

100  RETURN 
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title:  R6DTENP.PR 

Author:  Copt.  Ajmal  Hussain 

Data:  Aug  B3 

Function: 

This  routino  roads  a  section  of  disk  file  into  an  intogor  data 
array.  Tho  Pile  and  data  section  are  speciPied  interactively 
by  the  user. 

V 

Compile  command: 

FORTRAN  REDTENP 

Comments: 

The  variables  ARRAY  and  LEN  that  are  passed  to  this  routine  are 
the  data  array  and  it's  length,  respectively.  On  return,  the  array 
contains  the  user  data. 


SUBROUTINE  REDTENP < ARRAY, LEN) 

INTEGER  LEN. ARRAY (LEN). FI LENAM < 7 > . 1FIRST. INUN. IDEC 

500  TYPE 

ACCEPT  " 

♦Enter  the  filename  for  reading: " 

READ  (11.2)  FILENAH(i) 

2  FORMAT  (513) 

CALL  OPEN  (l.FILENAM. 2, IER) 

IF  (IER.  Ed  13)  CO  TO  510 

IF  (IER.  NE.  I)  TYPE  "OPEN  error", IER 

IFIRST-0 

INUN-13 

CALL  RDBLKd.  IFIRST.  ARRAY.  INUN.  IER) 

IF  (IER. NE1)  TYPE  "RDBLK  error”. IER 
IF  (IER.  NE.  1 )  GO  TO  520 
CALL  RESET 
GO  TO  100 

510  TYPE  “<CR> 

•This  Pile  does  not  eiist. " 

00  TO  520 

520  CALL  RESET 

ACCEPT  "<CR> 

•Do  you  want  to. <CR> 

*  1:  try  another  file<CR> 

•  2:  return  to  the  main  menu<CR> 

•selection: IDEC 


IF  (IDEC  EQ.  1>  CO  TO  500 
IF  (IDEC.  EQ.  2)  CO  TO  100 
WRITE  (10. 1) 

1  FORMAT  ( "<CR><CR><CR> 

•Pleose  uki  ••lections  only  from  th*  given  options.  "> 
CO  TO  520 

100  RETURN 
END 


Title:  SEEMAT.FR 

Author:  Copt.  Ajmol  Hussain 

Goto:  Aug  83 

Function: 

This  routine  display*  section*  of  an  integer  data  array  on  the 
screen  in  128-word  pages.  The  calling  program  specifies  all  the 
parameters  required. 

This  routine  was  designed  for  displaying  data  collected  with  the 
Eclipse  A/D/A  device.  When  executing  the  real  number  display 
option,  the  integer  word  is  converted  to  the  real  number 
equivalent  that  this  device  uses  to  store  data  samples. 

Compile  command: 

FORTRAN  SEEMAT 

Comments: 

The  variables  that  are  passed  to  this  routine  have  the  following 
meaning. 


ARRAY 


the  data  array  to  be  shown 
the  length  of  the  data  array 


SUBROUTINE  SEEMAT (ARRAY.  LEN) 

INTEGER  IFOR.  ISTART. ISTOP. LEN,  ITOT,  IPAGE 
REAL  REALNUM. TOP VOLT. ARRAY! LEN) 

SOO  ACCEPT  "<CR> 

•There  are  79  pages  of  data,  numbered  1  through  79, <CR> 
•with  each  page  containing  128  values.  <CRXCR> 

•What  page  will  be  first?  ". ISTART 
ACCEPT  “ 

•What  page  will  be  last?  ".  ISTOP 

IF  < ISTART. LT. 1)  GO  TO  300 
IF  < ISTOP.  CT.  79)  GO  TO  500 
I TOT-79 

303  TYPE  "<CRXCR> 

•Press  carriage  return  to  begin  and<CR> 

•to  continue  with  the  next  page.  <CR>" 

ACCEPT 

I PACE- I START- 1 
I I— ( ISTART-1 )*128 
310  12-0 

IPACE-IPAGErl 

TYPE  "<CR>  page",  IPAOE.  "  of".  ITOT,  "<CR>" 
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Aeronautical  Engineering  with  the  degree  of  Bachelor  of 
Electrical  Engineering  with  Honor.  He  entered  the  School  of 
Engineering,  Air  Force  Institute  of  Technology  in  June  1982. 
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